-- Logs begin at Tue 2022-07-26 14:32:43 UTC, end at Tue 2022-07-26 15:54:16 UTC. -- Jul 26 15:25:50.720159 dv-cinder-851032-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 15:25:50.730816 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 15:25:50 2022] *** Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: nodename: dv-cinder-851032-1-iscsi Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: machine: x86_64 Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: clock source: unix Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: pcre jit disabled Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: detected number of CPU cores: 4 Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: current working directory: / Jul 26 15:25:50.732823 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: detected binary path: /usr/bin/uwsgi-core Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: your processes number limit is 47680 Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: your memory page size is 4096 bytes Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: detected max file descriptor number: 2048 Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: lock engine: pthread robust mutexes Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: thunder lock: enabled Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 15:25:50.733532 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 15:25:50.771926 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: Python main interpreter initialized at 0x55cd4422d9c0 Jul 26 15:25:50.771926 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: python threads support enabled Jul 26 15:25:50.771926 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: your server socket listen backlog is limited to 100 connections Jul 26 15:25:50.771926 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: your mercy for graceful operations on workers is 90 seconds Jul 26 15:25:50.772325 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 15:25:50.772416 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: *** Operational MODE: preforking *** Jul 26 15:25:50.772638 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: *** uWSGI is running in multiple interpreter mode *** Jul 26 15:25:50.772638 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: spawned uWSGI master process (pid: 103829) Jul 26 15:25:50.772852 dv-cinder-851032-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 15:25:50.773414 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: spawned uWSGI worker 1 (pid: 103830, cores: 1) Jul 26 15:25:50.773751 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: spawned uWSGI worker 2 (pid: 103831, cores: 1) Jul 26 15:25:50.774796 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 15:25:51.441451 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:25:51.446527 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:25:52.533372 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:25:52.533372 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: from cryptography.utils import int_from_bytes Jul 26 15:25:52.534024 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:25:52.534024 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: from cryptography.utils import int_from_bytes Jul 26 15:25:52.539122 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:25:52.539122 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: from cryptography.utils import int_from_bytes Jul 26 15:25:52.539568 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:25:52.539568 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: from cryptography.utils import int_from_bytes Jul 26 15:25:55.017835 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:25:55.018406 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:25:55.018607 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:25:55.018977 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:25:55.019232 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:25:55.019490 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:25:55.019866 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.019962 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:25:55.020061 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.020242 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.020331 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:25:55.020587 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.020692 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:25:55.020873 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:25:55.020971 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021218 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021304 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021540 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021626 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021860 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.021961 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022173 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022268 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022436 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022521 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022752 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.022847 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023077 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851032-1-iscsi {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023173 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023398 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023483 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023708 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023802 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.023968 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024062 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024280 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024381 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024626 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851032-1-iscsi {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024726 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.024945 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025032 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025260 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025363 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025558 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025760 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.025864 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027041 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027189 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027333 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027471 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027609 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027734 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027734 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.027983 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028138 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028273 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028399 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028550 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028676 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028804 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.028929 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029043 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029180 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029305 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029439 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029710 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851032-1-iscsi {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029824 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.029824 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.030081 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.030081 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.030919 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.030919 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031172 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031305 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851032-1-iscsi {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031449 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031631 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031760 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.031960 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032103 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032230 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032355 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032517 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032647 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032785 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.032911 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033180 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033388 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033547 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033687 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033821 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.033947 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034117 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034261 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034403 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034536 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034714 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.034843 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035023 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035161 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035342 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035486 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035627 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035823 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.035950 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036089 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036223 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036356 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036517 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036657 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036785 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.036918 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037107 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037238 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037371 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037494 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037661 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037790 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.037925 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038050 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038347 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038530 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038661 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038829 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.038957 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039081 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039215 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039382 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039518 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039700 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.039828 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040007 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040136 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040308 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040441 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040764 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.040939 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041069 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041244 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041382 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041551 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041690 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041856 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.041987 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042161 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042297 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042476 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042611 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042784 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.042913 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.128 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043102 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043253 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.128 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043446 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043572 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043707 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.043832 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044040 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044168 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.128 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044326 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.128 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044521 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044660 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044786 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.044979 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045109 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045286 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045421 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045589 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045718 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.045955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046117 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046286 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046432 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046588 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046684 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.046913 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047012 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047162 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047260 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047463 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047579 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047767 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.047908 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048084 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048211 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048389 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048551 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048721 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.048825 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049123 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049329 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049521 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049660 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049787 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.049921 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050047 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050215 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050344 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050513 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050641 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050816 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.050952 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051116 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051244 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051418 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051553 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051718 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.051847 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052017 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052151 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052316 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052453 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052646 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052776 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.052948 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053086 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053249 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053391 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053601 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053730 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053869 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.053993 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054151 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054289 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054452 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054753 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.054890 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055055 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055194 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055360 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055555 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055698 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055824 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.055948 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056165 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056370 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056518 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056657 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056795 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.056929 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057070 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057196 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057329 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057462 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057588 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057720 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.057857 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058026 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058155 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058324 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058452 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058623 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058751 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.058926 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059060 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059227 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059353 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059525 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059653 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059823 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.059949 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060123 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060249 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060419 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060569 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060741 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.060880 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061041 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061177 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061343 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061527 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061667 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061793 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.061965 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.062166 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.062419 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.062549 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.062754 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.062882 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.063072 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.063212 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.063377 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.063505 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.063721 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:25:55.063852 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064013 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064156 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064341 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064560 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064727 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.064855 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065003 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065150 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065332 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065463 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065659 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065796 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.065971 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066100 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066278 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066484 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066621 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066746 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.066883 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067009 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067192 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067320 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067500 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067628 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067808 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.067964 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.068123 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.068253 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.068440 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.068626 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.068826 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069017 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069215 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069396 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069581 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069764 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.069909 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.070037 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.070274 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.070597 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.070795 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.070924 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071124 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071254 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071473 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071609 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071821 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.071961 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072140 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072276 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072457 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072609 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072796 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.072943 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073107 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073237 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073415 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073546 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073762 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.073911 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074046 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074183 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074355 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074484 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074664 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074801 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.074979 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075108 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075287 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075416 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075584 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075723 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.075886 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076016 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076193 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076321 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076526 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076645 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076857 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.076957 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.077687 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.077843 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078002 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078152 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078391 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078503 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078711 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.078815 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079023 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079126 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079332 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079428 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079640 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079742 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.079929 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080011 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080236 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080331 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080563 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080671 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080871 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.080956 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081171 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081264 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081489 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081582 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081808 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.081892 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082113 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082205 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082441 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082536 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082744 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.082829 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083050 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083135 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083359 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083452 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083664 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083757 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.083968 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084061 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084280 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084446 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084639 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084794 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.084935 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085076 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085236 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085377 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085516 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085655 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085795 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.085933 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086083 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086223 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086384 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086531 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086757 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.086904 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087064 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087222 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087370 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087511 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087649 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087798 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.087938 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088076 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088216 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088364 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088565 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088730 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.088880 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089048 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089196 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089337 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089476 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089624 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089772 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.089912 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090084 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090239 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090388 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090549 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090691 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090829 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.090979 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091118 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091265 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091415 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091562 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091702 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091841 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.091980 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.092269 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.092409 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.092583 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.092764 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.093528 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.093685 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094058 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094217 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094373 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094532 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094673 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094822 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.094964 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095103 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095242 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095381 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095541 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095682 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095829 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.095979 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096119 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096258 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096407 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096735 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.096735 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097081 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097231 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097389 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097546 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097694 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097835 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.097983 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098124 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098278 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098419 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098558 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098698 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098844 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.098998 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099140 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099279 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099427 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099567 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099706 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.099854 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100001 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100141 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100288 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100428 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100678 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100760 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100869 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.100969 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101179 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101276 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101502 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101609 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101808 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.101894 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102125 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102222 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102428 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102515 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102741 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.102825 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103075 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103168 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103403 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103487 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103716 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.103801 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.104034 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.104129 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.104344 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.104474 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.104680 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105036 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105241 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105336 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105550 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105641 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105858 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.105941 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106163 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106257 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106481 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106574 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106789 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.106874 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107104 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107191 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107412 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107495 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107729 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.107821 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108038 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108135 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108422 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108590 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108765 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.108900 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109144 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109284 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109422 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109573 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109725 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.109867 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110020 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110170 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110344 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110484 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110631 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110790 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.110927 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111069 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111213 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111488 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111648 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111785 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.111934 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112074 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112223 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112424 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112632 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112780 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.112936 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113045 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113126 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113434 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113594 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113731 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.113832 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114031 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114108 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114337 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114413 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114651 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114797 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.114935 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115020 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115246 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115339 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115562 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115646 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115870 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.115957 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116188 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116289 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116527 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116832 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.116925 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117132 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117226 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117451 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117545 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117758 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.117843 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118059 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118144 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118363 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118453 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118664 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.118758 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119003 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119087 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119313 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119407 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119709 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.119927 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120018 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120246 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120331 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120579 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120692 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120893 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.120979 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121202 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121285 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121507 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121601 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121823 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.121908 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122134 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122218 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122440 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122534 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122751 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.122844 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123061 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123145 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123388 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123527 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123677 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.123762 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124012 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124152 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124309 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124458 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124777 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124882 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.124963 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125128 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125252 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125434 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125561 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125746 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.125882 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.126065 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.126459 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.126632 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.126860 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127027 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127192 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127357 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127516 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127679 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.127839 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128001 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128162 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128321 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128515 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128680 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.128850 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129008 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129189 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129343 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129499 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129649 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129814 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.129959 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130122 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130264 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130430 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130566 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130741 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.130876 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131048 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131181 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131355 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131486 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131658 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131790 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.131954 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132098 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132258 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132402 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132587 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132731 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.132892 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133039 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133202 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133497 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133657 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133801 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.133961 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134113 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134273 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134422 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134576 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134744 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.134898 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135053 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135205 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135356 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135508 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135660 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135812 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.135966 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136118 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136309 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136444 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136653 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136766 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.136993 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137081 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137325 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137668 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137765 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.137977 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138063 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138285 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138371 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138608 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138702 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138913 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.138999 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.139213 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.139297 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.139517 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140130 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140370 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140566 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140715 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140819 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.140987 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141075 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141296 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141423 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141605 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141690 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141912 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.141999 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142218 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142301 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142524 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142654 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142829 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.142908 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143130 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143213 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143448 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143544 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143755 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.143839 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144058 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144150 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144358 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144452 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144690 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144780 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.144997 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145084 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145298 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145390 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145602 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145695 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145904 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.145997 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146215 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146308 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146524 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146689 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146837 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.146978 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147139 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147280 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147421 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147560 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147807 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.147962 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148117 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148263 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148404 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148623 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148765 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.148906 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149071 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149187 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149269 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149346 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149471 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149566 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149772 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.149859 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150074 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150159 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150380 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150463 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150700 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.150787 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151015 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151101 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151312 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151406 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151619 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151715 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.151918 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152003 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152217 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152310 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152538 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152626 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152846 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.152942 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153144 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153238 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153445 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153528 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153741 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.153871 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154041 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154126 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154336 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154420 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154654 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154739 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.154960 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.155047 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.155306 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.155964 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.156256 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.156423 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.156603 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.156743 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.156924 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157090 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157237 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157397 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157559 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157682 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157864 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.157951 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158178 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158275 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158500 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158593 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158809 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.158907 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159119 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159212 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159431 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159515 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159733 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.159817 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160049 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160198 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160359 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160455 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160698 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.160797 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161002 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161102 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161303 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161395 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161623 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161708 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.161934 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162030 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162240 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162325 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162557 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162643 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162878 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.162964 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163195 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163282 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163497 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163581 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163809 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.163945 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164114 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164199 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164420 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164550 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164752 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.164839 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165062 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165148 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165371 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165455 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165679 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165765 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.165989 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166075 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166297 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166389 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166605 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166690 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166909 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.166995 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167216 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167314 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167523 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167608 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167825 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.167911 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168145 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168239 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168454 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168557 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168776 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.168863 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169082 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169177 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169388 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169471 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169695 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.169779 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170000 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170094 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170427 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170511 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170739 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.170833 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171140 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171292 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171440 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171585 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171800 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.171895 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172112 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172199 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172426 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172577 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172764 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.172850 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173070 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173158 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173484 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173577 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173802 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.173926 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174110 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174187 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174426 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174540 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174724 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.174820 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175025 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175112 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175332 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175461 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175651 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175746 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.175953 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176038 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176256 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176343 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176686 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.176983 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.177199 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.177284 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.177516 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.177603 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.177925 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178011 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178235 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178328 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178542 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178628 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.178954 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179038 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179262 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179348 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179569 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179657 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179887 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.179983 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.180206 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.180292 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.180552 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.180655 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.180859 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181031 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181171 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181266 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181477 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181564 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181798 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.181885 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182119 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182205 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182428 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182513 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182742 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.182835 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183043 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183128 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183363 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183457 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183685 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.183994 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.184085 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.184312 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.184405 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.184744 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.184833 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185068 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185154 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185380 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185478 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185699 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.185796 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186021 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186106 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186334 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186483 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186658 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186813 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.186960 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187093 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187472 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187609 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187748 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187866 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.187982 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188098 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188280 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188414 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188633 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188772 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.188952 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189058 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189263 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189351 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189565 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189650 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189870 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.189966 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190191 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190285 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190496 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190589 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190818 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.190913 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191129 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191215 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191450 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191544 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191771 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.191866 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192075 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192160 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192395 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192501 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192731 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.192832 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193039 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193126 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193343 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193428 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193650 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193735 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.193988 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194074 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194293 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194393 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194612 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194706 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.194938 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195025 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195265 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195363 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195573 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195702 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195903 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.195990 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196229 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196323 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196576 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196691 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196893 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.196991 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197217 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197329 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197526 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197829 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.197923 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198136 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198238 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198439 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198547 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198742 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.198843 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199047 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199148 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199351 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199459 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199655 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199757 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.199956 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200063 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200257 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200349 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200600 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200696 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.200905 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201006 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201221 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201314 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201528 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201637 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201829 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.201928 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.202660 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.202809 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.202972 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.203117 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.203360 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.203458 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.203702 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.203792 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204036 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204124 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204354 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204451 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204699 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.204792 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205026 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205127 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205334 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205422 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205656 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205743 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.205972 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206067 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206287 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206372 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206603 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206689 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.206918 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207013 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207233 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207319 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207549 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207636 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207863 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.207958 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208171 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208256 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208504 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208595 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208822 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.208916 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.209137 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.209222 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.209678 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.209764 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210075 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210170 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210396 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210482 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210713 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.210798 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211113 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211340 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211426 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211653 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211737 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.211965 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212052 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212277 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212361 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212609 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212708 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.212926 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213020 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213337 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213574 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213672 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213893 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.213979 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214228 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214322 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214544 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214627 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214860 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.214954 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215174 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215268 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215487 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215573 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215842 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.215933 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216155 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216250 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216499 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216589 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.216894 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.217115 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.217210 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.217427 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.217512 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.217763 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.218410 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.218587 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.218715 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.218905 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219031 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219215 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219301 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219526 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219621 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219832 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.219917 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220144 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220239 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220457 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220584 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220803 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.220888 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221137 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221222 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221456 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221542 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221768 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.221854 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222078 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222178 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222391 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222475 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222907 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.222991 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223222 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223317 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223554 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223647 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223879 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.223963 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224199 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224298 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224538 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224626 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224855 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.224939 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225179 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225282 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225485 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225580 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225786 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.225871 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226096 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226182 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226402 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226486 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226704 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.226797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227021 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227107 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227328 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227412 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227631 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227723 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.227951 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.228039 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.228257 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.228343 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.228815 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.228915 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.229167 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.229253 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.229480 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.229564 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230056 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230160 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230379 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230464 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230695 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230788 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.230999 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231097 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231321 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231414 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231625 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231718 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.231927 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232021 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232238 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232323 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232643 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232741 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232876 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.232976 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.233178 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.233263 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234073 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234226 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234445 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234579 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234710 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.234889 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235024 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235201 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235329 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235506 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235656 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235834 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.235963 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236141 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236268 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236447 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236600 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.236894 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237082 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237184 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237388 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237482 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237690 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237776 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.237994 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238081 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238446 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238533 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238611 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238689 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238881 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.238970 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239191 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239278 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239495 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239580 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239807 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.239894 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240110 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240196 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240554 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240792 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.240879 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241094 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241178 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241400 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241495 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241702 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.241788 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242014 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242098 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242321 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242415 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242638 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242722 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.242949 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243035 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243261 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243355 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243599 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243683 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.243913 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.244134 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.244445 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.244563 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.244801 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.244889 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245121 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245220 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245453 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245590 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245760 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.245845 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246067 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246161 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246370 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246458 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246674 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246760 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.246993 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247077 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247300 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247396 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247605 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247695 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.247912 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248007 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248221 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248306 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248553 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248645 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248864 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.248963 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.249270 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250092 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250179 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250503 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250616 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250852 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.250933 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251015 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251200 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251311 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251513 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251629 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251825 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.251970 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252138 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252289 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252452 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252637 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252815 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.252958 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253135 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253278 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253453 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253591 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253769 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.253901 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254092 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254210 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254402 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254520 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254709 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.254845 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255018 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255178 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255328 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255492 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255644 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255800 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.255970 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.256222 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.256310 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.256560 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.256652 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.256881 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257011 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257204 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257323 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257516 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257642 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257841 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.257960 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.258164 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.258271 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.258576 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.258944 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259030 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259271 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259359 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259586 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259672 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.259907 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260007 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260219 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260317 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260578 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260666 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260892 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.260988 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261202 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261288 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261511 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261596 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261824 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.261923 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262128 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262221 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262433 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262519 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262737 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.262876 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263043 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263138 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263348 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263433 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263649 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263746 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.263950 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.264036 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.264253 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.264339 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.264577 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.265163 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.265435 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.265530 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.265855 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266009 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266241 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266376 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266555 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266689 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266865 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.266993 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267176 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267298 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267484 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267601 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267796 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.267950 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.268104 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.268201 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.268540 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.268756 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.268843 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.269283 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.269637 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.269734 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.269957 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.270190 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.270687 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.270782 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271006 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271091 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271318 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271412 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271627 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271723 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.271963 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272050 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272298 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272385 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272647 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272764 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.272974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273064 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273288 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273373 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273599 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273684 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.273910 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274003 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274232 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274327 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274544 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274629 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274858 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.274951 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275169 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275262 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275482 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275577 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275793 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.275922 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.276101 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.276195 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.276596 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.276828 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.277062 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.277551 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.277649 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.277875 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.277963 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278191 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278285 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278524 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278610 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278852 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.278939 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279160 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279255 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279487 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279582 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279807 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.279902 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.280119 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.280205 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.281132 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.281623 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.281721 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.281804 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.281883 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282000 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282087 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282316 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282521 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282638 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282841 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.282957 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.283160 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.283285 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.283479 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.283631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.284082 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.284176 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.284580 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.284938 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285082 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285266 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285492 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285580 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285817 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286168 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286267 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286504 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286600 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286817 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.286907 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.287135 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.287229 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.287448 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.287551 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.287695 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:25:55.287782 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.288115 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.288434 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.288801 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.289133 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.289452 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.289765 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.290070 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:25:55.290314 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103831) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:25:55.442419 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO dbcounter [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Registered counter for database nova_api Jul 26 15:25:55.445663 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO dbcounter [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Registered counter for database nova_api Jul 26 15:25:55.463652 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_db.sqlalchemy.engines [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.467204 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_db.sqlalchemy.engines [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.471002 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writer thread running {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.474405 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writer thread running {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.528374 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.context [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06f98f67-0c8d-404d-9439-56d0670c1f78(cell1) {{(pid=103830) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:25:55.531358 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.context [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06f98f67-0c8d-404d-9439-56d0670c1f78(cell1) {{(pid=103831) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:25:55.532395 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:55.534010 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:55.534817 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:55.535281 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_concurrency.lockutils [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:55.536870 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:55.536977 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_concurrency.lockutils [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:55.537648 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_concurrency.lockutils [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:55.538862 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO dbcounter [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Registered counter for database nova_cell0 Jul 26 15:25:55.539612 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_concurrency.lockutils [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:55.541640 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO dbcounter [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Registered counter for database nova_cell0 Jul 26 15:25:55.544349 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO dbcounter [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Registered counter for database nova_cell1 Jul 26 15:25:55.548357 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO dbcounter [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Registered counter for database nova_cell1 Jul 26 15:25:55.553754 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_db.sqlalchemy.engines [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.554581 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_db.sqlalchemy.engines [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.556791 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_db.sqlalchemy.engines [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.558986 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_db.sqlalchemy.engines [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.562044 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writer thread running {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.563503 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writer thread running {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.565089 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writer thread running {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.567866 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writer thread running {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.708682 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO dbcounter [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Registered counter for database nova_cell0 Jul 26 15:25:55.716175 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO dbcounter [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Registered counter for database nova_cell0 Jul 26 15:25:55.717431 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_db.sqlalchemy.engines [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.722557 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writer thread running {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:55.725354 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG oslo_db.sqlalchemy.engines [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103831) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:25:55.730073 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writer thread running {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:25:56.128999 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: WARNING keystonemiddleware.auth_token [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:25:56.136291 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: WARNING keystonemiddleware.auth_token [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:25:56.167559 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: WARNING keystonemiddleware.auth_token [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:25:56.175883 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: WARNING keystonemiddleware.auth_token [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:25:56.481776 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: WARNING keystonemiddleware.auth_token [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:25:56.488691 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: WARNING keystonemiddleware.auth_token [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:25:56.494037 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd4422d9c0 pid: 103830 (default app) Jul 26 15:25:56.496116 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:56.497312 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] 10.222.0.128 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001756 Jul 26 15:25:56.497717 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 1/1] 10.222.0.128 () {50 vars in 793 bytes} [Tue Jul 26 15:25:56 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:25:56.533279 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: WARNING keystonemiddleware.auth_token [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:25:56.539172 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: WARNING keystonemiddleware.auth_token [None req-0309ec66-a5fe-4ede-9406-4b34a6dad9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:25:56.544395 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd4422d9c0 pid: 103831 (default app) Jul 26 15:27:16.340413 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:16.342648 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002610 Jul 26 15:27:16.343055 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 2/2] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:16 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:16.355350 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_api:SELECT=3 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:16.357739 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_cell0:SELECT=3 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:16.358857 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_cell1:SELECT=3 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:16.360222 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:17.261050 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-55ca2833-c8e9-4503-9dd9-35c3fa9a12b6 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:17.297483 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-55ca2833-c8e9-4503-9dd9-35c3fa9a12b6 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.947574 Jul 26 15:27:17.298470 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 1/3] 10.222.0.128 () {60 vars in 1296 bytes} [Tue Jul 26 15:27:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:27:19.587640 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:19.588674 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-44e88a5b-5f40-43aa-a8cf-f08227d9d094 None None] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001418 Jul 26 15:27:19.589080 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 3/4] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:19 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:20.015821 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-cfb6e57e-268d-4c5c-ac43-f23c9bed859f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:20.037185 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:20.037185 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: warnings.warn(msg) Jul 26 15:27:20.137102 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-cfb6e57e-268d-4c5c-ac43-f23c9bed859f admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.540343 Jul 26 15:27:20.140556 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 2/5] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:20.151296 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_api:SELECT=3 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:20.152512 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_cell1:SELECT=3 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:20.154525 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_cell0:SELECT=3 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:20.155257 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:20.366291 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-76ed1f98-2ade-4028-8b0c-9d3c91d307d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:20.371249 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:20.371249 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:27:20.529331 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-76ed1f98-2ade-4028-8b0c-9d3c91d307d4 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.368833 Jul 26 15:27:20.529331 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 4/6] 10.222.0.128 () {64 vars in 1340 bytes} [Tue Jul 26 15:27:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:22.768997 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-cfb6e57e-268d-4c5c-ac43-f23c9bed859f admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:22.770016 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-cfb6e57e-268d-4c5c-ac43-f23c9bed859f admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001519 Jul 26 15:27:22.770567 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 3/7] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:23.478707 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-6ca16d01-6fa6-41b5-99c0-7489224fd60a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:23.498289 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:23.498289 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:27:23.614954 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-6ca16d01-6fa6-41b5-99c0-7489224fd60a admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.838555 Jul 26 15:27:23.615447 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 5/8] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:23.630586 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-5d6f4885-4807-4d34-b0bf-3fa565f228a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:23.634253 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:23.634253 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: warnings.warn(msg) Jul 26 15:27:23.761295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-5d6f4885-4807-4d34-b0bf-3fa565f228a8 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135784 Jul 26 15:27:23.768606 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 4/9] 10.222.0.128 () {64 vars in 1340 bytes} [Tue Jul 26 15:27:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:26.036925 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-6ca16d01-6fa6-41b5-99c0-7489224fd60a admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:26.037928 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-6ca16d01-6fa6-41b5-99c0-7489224fd60a admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001476 Jul 26 15:27:26.038320 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 6/10] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:26.438336 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-db1d01b3-c3ab-4340-ba3f-5b73ba01f2c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:26.508427 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-db1d01b3-c3ab-4340-ba3f-5b73ba01f2c0 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464037 Jul 26 15:27:26.509005 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 5/11] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:26.521805 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-cc050a8e-de6c-44a3-bd76-fa397c604b0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:26.621202 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-cc050a8e-de6c-44a3-bd76-fa397c604b0f admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103044 Jul 26 15:27:26.622682 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 7/12] 10.222.0.128 () {64 vars in 1340 bytes} [Tue Jul 26 15:27:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:28.838827 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-db1d01b3-c3ab-4340-ba3f-5b73ba01f2c0 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:28.839832 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-db1d01b3-c3ab-4340-ba3f-5b73ba01f2c0 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Jul 26 15:27:28.840458 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 6/13] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:28 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:29.306699 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-f7533c92-0069-426f-a6bb-68f2a4105b6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:29.400585 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-f7533c92-0069-426f-a6bb-68f2a4105b6e admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.551028 Jul 26 15:27:29.400585 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 8/14] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:27:29.414291 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6e5911c2-9860-4cae-b291-135812e9aad3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:29.503923 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6e5911c2-9860-4cae-b291-135812e9aad3 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093207 Jul 26 15:27:29.506309 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 7/15] 10.222.0.128 () {64 vars in 1340 bytes} [Tue Jul 26 15:27:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:31.776567 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-f7533c92-0069-426f-a6bb-68f2a4105b6e admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:31.778225 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-f7533c92-0069-426f-a6bb-68f2a4105b6e admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001479 Jul 26 15:27:31.778627 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 9/16] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:31 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:32.241198 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:32.372695 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.587749 Jul 26 15:27:32.378275 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 8/17] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:32.384883 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-49fc2fec-4f91-4e28-858a-bbe48df425e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:32.482725 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-49fc2fec-4f91-4e28-858a-bbe48df425e4 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101421 Jul 26 15:27:32.483319 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 10/18] 10.222.0.128 () {64 vars in 1340 bytes} [Tue Jul 26 15:27:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:34.709948 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:34.710944 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001457 Jul 26 15:27:34.711281 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 9/19] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:34 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:35.141810 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-c4a01b9b-3ec8-45a4-a43f-290186e23005 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:35.166589 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-c4a01b9b-3ec8-45a4-a43f-290186e23005 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.448272 Jul 26 15:27:35.167145 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 11/20] 10.222.0.128 () {60 vars in 1296 bytes} [Tue Jul 26 15:27:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:27:37.635434 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:37.637059 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-3c9b5b53-c0e2-4c3a-a137-a7fcb5dbf4e7 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001440 Jul 26 15:27:37.637713 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 10/21] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:37 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:38.077512 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-3f913c24-cbee-4109-bb79-7e9873b4360f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:38.172306 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-3f913c24-cbee-4109-bb79-7e9873b4360f admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.528418 Jul 26 15:27:38.172899 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 12/22] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:38.185564 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-5574049c-eaa1-4a59-a971-9d40f99a9813 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:38.393519 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-5574049c-eaa1-4a59-a971-9d40f99a9813 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.212237 Jul 26 15:27:38.394070 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 11/23] 10.222.0.128 () {64 vars in 1337 bytes} [Tue Jul 26 15:27:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:40.714569 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-3f913c24-cbee-4109-bb79-7e9873b4360f admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:40.715748 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-3f913c24-cbee-4109-bb79-7e9873b4360f admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001748 Jul 26 15:27:40.716153 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 13/24] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:40 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:27:41.126558 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-1ef14487-2f29-4b0d-80f1-bb9c4c19dad4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "2", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:41.217255 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-1ef14487-2f29-4b0d-80f1-bb9c4c19dad4 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495127 Jul 26 15:27:41.218086 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 12/25] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:27:41.229941 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-3b74415b-5c3a-4375-b10f-18633372cd76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:41.317918 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-3b74415b-5c3a-4375-b10f-18633372cd76 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092044 Jul 26 15:27:41.318500 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 14/26] 10.222.0.128 () {64 vars in 1337 bytes} [Tue Jul 26 15:27:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:43.562320 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-1ef14487-2f29-4b0d-80f1-bb9c4c19dad4 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:43.563349 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-1ef14487-2f29-4b0d-80f1-bb9c4c19dad4 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001471 Jul 26 15:27:43.563764 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 13/27] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:43.925789 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-73bb0211-d43a-4827-93c4-9149b2230cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:44.009655 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-73bb0211-d43a-4827-93c4-9149b2230cc4 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.439976 Jul 26 15:27:44.010229 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 15/28] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:44.023233 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-cab3e7b3-809f-4a76-bb4d-7027b77d1638 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:44.083414 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-cab3e7b3-809f-4a76-bb4d-7027b77d1638 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063741 Jul 26 15:27:44.083923 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 14/29] 10.222.0.128 () {64 vars in 1337 bytes} [Tue Jul 26 15:27:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:46.408948 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-73bb0211-d43a-4827-93c4-9149b2230cc4 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:46.410594 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-73bb0211-d43a-4827-93c4-9149b2230cc4 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002200 Jul 26 15:27:46.411062 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 16/30] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:46 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:46.871648 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-a69a72d4-9158-4c56-9d32-122ba841af06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:46.877962 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:46.943681 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-a69a72d4-9158-4c56-9d32-122ba841af06 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526330 Jul 26 15:27:46.944438 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 15/31] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:27:46.956657 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-c631646f-73d3-4249-947d-15cd2caea877 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:47.033053 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-c631646f-73d3-4249-947d-15cd2caea877 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079994 Jul 26 15:27:47.033942 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 17/32] 10.222.0.128 () {64 vars in 1337 bytes} [Tue Jul 26 15:27:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:49.318145 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-a69a72d4-9158-4c56-9d32-122ba841af06 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:49.319152 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-a69a72d4-9158-4c56-9d32-122ba841af06 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001463 Jul 26 15:27:49.319547 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 16/33] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:27:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:49.782918 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "id": "5"}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:49.851336 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.524467 Jul 26 15:27:49.851906 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 18/34] 10.222.0.128 () {64 vars in 1287 bytes} [Tue Jul 26 15:27:49 2022] POST /compute/v2.1/flavors => generated 410 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:49.865084 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-de825634-4f66-479d-b697-35c8e5b4d505 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:49.970006 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-de825634-4f66-479d-b697-35c8e5b4d505 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108491 Jul 26 15:27:49.978424 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 17/35] 10.222.0.128 () {64 vars in 1337 bytes} [Tue Jul 26 15:27:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:10.527864 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:10.528905 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 Jul 26 15:28:10.529304 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 19/36] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:28:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:28:10.920666 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-65eb52a1-34f2-4577-9b98-444d16bf798e admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:10.939491 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-65eb52a1-34f2-4577-9b98-444d16bf798e admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.404321 Jul 26 15:28:10.939964 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 18/37] 10.222.0.128 () {60 vars in 1296 bytes} [Tue Jul 26 15:28:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:28:12.016033 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.017090 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-a53c29d6-7827-49a3-9c32-2d0852ff41ff admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001461 Jul 26 15:28:12.017477 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 20/38] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:12.552917 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-f794e085-a0fe-43d2-a4d7-64ffc0cfe7ea admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.558827 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.wsgi [None req-f794e085-a0fe-43d2-a4d7-64ffc0cfe7ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-f794e085-a0fe-43d2-a4d7-64ffc0cfe7ea admin admin] Request method failure captured: Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept: application/json Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept-Encoding: gzip, deflate Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Connection: keep-alive Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Content-Length: 0 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Host: 10.222.0.128 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-System-Scope: None Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: User-Agent: python-novaclient Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Auth-Token: gAAAAABi4AgLT0fXvmTWS7jkHtxZLizf3CKrLj4WLtgqJn6AE_LugQ7-YNxmxvOGP_cIT9TxudrlO37U_872154PMrCmvESHxTwIGsvijL6SsI3hLFQ3q9AIVCcUgt2Fa37G75vp5mKGR0fUpGUNg0OqyeA0qBuYOUi44bxlc4aje_h3rTS9BI4 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Id: None Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Name: None Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Identity-Status: Confirmed Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Is-Admin-Project: True Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Id: default Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Name: Default Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Name: admin Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Role: member,reader,admin Jul 26 15:28:12.562184 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Roles: member,reader,admin Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant: admin Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Name: admin Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User: admin Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Id: default Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Name: Default Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Name: admin Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: method: > Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: exception: Flavor 42 could not be found. Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: action_args: {'id': '42'} Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:12.563897 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:12.564850 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.566167 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-f794e085-a0fe-43d2-a4d7-64ffc0cfe7ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:12.567473 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-f794e085-a0fe-43d2-a4d7-64ffc0cfe7ea admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403000 Jul 26 15:28:12.567473 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 19/39] 10.222.0.128 () {60 vars in 1195 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:12.574073 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-cb30c8ea-a9b0-481b-a150-d5b0f9812eb8 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.578448 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:12.597416 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-cb30c8ea-a9b0-481b-a150-d5b0f9812eb8 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027561 Jul 26 15:28:12.597968 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 21/40] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:28:12.608223 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-8c0d6952-62fd-41da-9a40-0eaa0ce14830 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.632412 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-8c0d6952-62fd-41da-9a40-0eaa0ce14830 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027863 Jul 26 15:28:12.632972 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 20/41] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:28:12.643206 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-d3dc43ec-7cea-4e08-97d8-6ad65ba01bb6 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.649340 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.wsgi [None req-d3dc43ec-7cea-4e08-97d8-6ad65ba01bb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-d3dc43ec-7cea-4e08-97d8-6ad65ba01bb6 admin admin] Request method failure captured: Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept: application/json Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept-Encoding: gzip, deflate Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Connection: keep-alive Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Content-Length: 0 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Host: 10.222.0.128 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-System-Scope: None Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: User-Agent: python-novaclient Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Auth-Token: gAAAAABi4AgLT0fXvmTWS7jkHtxZLizf3CKrLj4WLtgqJn6AE_LugQ7-YNxmxvOGP_cIT9TxudrlO37U_872154PMrCmvESHxTwIGsvijL6SsI3hLFQ3q9AIVCcUgt2Fa37G75vp5mKGR0fUpGUNg0OqyeA0qBuYOUi44bxlc4aje_h3rTS9BI4 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Id: None Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Name: None Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Identity-Status: Confirmed Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Is-Admin-Project: True Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Id: default Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Name: Default Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Name: admin Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Role: member,reader,admin Jul 26 15:28:12.653350 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Roles: member,reader,admin Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant: admin Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Name: admin Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User: admin Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Id: default Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Name: Default Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Name: admin Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: method: > Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: exception: Flavor 42 could not be found. Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: action_args: {'id': '42'} Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:12.654955 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:12.656027 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:12.667937 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-d3dc43ec-7cea-4e08-97d8-6ad65ba01bb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:12.669104 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-d3dc43ec-7cea-4e08-97d8-6ad65ba01bb6 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015151 Jul 26 15:28:12.669104 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 22/42] 10.222.0.128 () {60 vars in 1195 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:13.645820 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-8c0d6952-62fd-41da-9a40-0eaa0ce14830 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:13.646822 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-8c0d6952-62fd-41da-9a40-0eaa0ce14830 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001434 Jul 26 15:28:13.647223 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 21/43] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:14.184205 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-fefd0aeb-221c-42d0-93da-6d78d6a199c1 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:14.189495 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.wsgi [None req-fefd0aeb-221c-42d0-93da-6d78d6a199c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-fefd0aeb-221c-42d0-93da-6d78d6a199c1 admin admin] Request method failure captured: Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept: application/json Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept-Encoding: gzip, deflate Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Connection: keep-alive Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Content-Length: 0 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Host: 10.222.0.128 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-System-Scope: None Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: User-Agent: python-novaclient Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Auth-Token: gAAAAABi4AgNmX4w2V4I1kmKYIGKXS_9zDppnCnW7G9M7YmXQe8F7vy4oLOlYY774WE90xZJd2gO1yDkdXt1G8QBeO3tkYsfoXuwvBqjeivnuzSZLwOci4c64W8bdzEs_abaL_Tx2wx-L0xTVR1kTavT8yRrNjk35RwidypPfu0qNRg-IcL6dC4 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Id: None Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Name: None Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Identity-Status: Confirmed Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Is-Admin-Project: True Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Id: default Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Name: Default Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Name: admin Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Role: member,reader,admin Jul 26 15:28:14.190974 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Roles: member,reader,admin Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant: admin Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Name: admin Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User: admin Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Id: default Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Name: Default Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Name: admin Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: method: > Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: exception: Flavor 84 could not be found. Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: action_args: {'id': '84'} Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:14.192287 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:14.193133 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.194261 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-fefd0aeb-221c-42d0-93da-6d78d6a199c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:14.195268 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-fefd0aeb-221c-42d0-93da-6d78d6a199c1 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404359 Jul 26 15:28:14.195268 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 23/44] 10.222.0.128 () {60 vars in 1195 bytes} [Tue Jul 26 15:28:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:14.202846 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-e0ad5458-1696-45ef-b650-4ba215e5aa79 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:14.217620 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-e0ad5458-1696-45ef-b650-4ba215e5aa79 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018419 Jul 26 15:28:14.218152 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 22/45] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:28:14.227796 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-252b32ff-7b69-417e-83a7-a98928b97e94 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:14.242775 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-252b32ff-7b69-417e-83a7-a98928b97e94 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018760 Jul 26 15:28:14.243308 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 24/46] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:28:14.254531 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-2be6c696-e7dc-4d63-9ccc-791b0fb743c4 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:14.260827 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.wsgi [None req-2be6c696-e7dc-4d63-9ccc-791b0fb743c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-2be6c696-e7dc-4d63-9ccc-791b0fb743c4 admin admin] Request method failure captured: Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept: application/json Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept-Encoding: gzip, deflate Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Connection: keep-alive Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Content-Length: 0 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Host: 10.222.0.128 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-System-Scope: None Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: User-Agent: python-novaclient Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Auth-Token: gAAAAABi4AgNmX4w2V4I1kmKYIGKXS_9zDppnCnW7G9M7YmXQe8F7vy4oLOlYY774WE90xZJd2gO1yDkdXt1G8QBeO3tkYsfoXuwvBqjeivnuzSZLwOci4c64W8bdzEs_abaL_Tx2wx-L0xTVR1kTavT8yRrNjk35RwidypPfu0qNRg-IcL6dC4 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Id: None Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Name: None Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Identity-Status: Confirmed Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Is-Admin-Project: True Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Id: default Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Name: Default Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Name: admin Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Role: member,reader,admin Jul 26 15:28:14.262770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Roles: member,reader,admin Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant: admin Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Name: admin Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User: admin Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Id: default Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Name: Default Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Name: admin Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: method: > Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: exception: Flavor 84 could not be found. Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: action_args: {'id': '84'} Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:14.264345 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:14.265386 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:14.266636 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-2be6c696-e7dc-4d63-9ccc-791b0fb743c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:14.267856 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-2be6c696-e7dc-4d63-9ccc-791b0fb743c4 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013252 Jul 26 15:28:14.267856 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 23/47] 10.222.0.128 () {60 vars in 1195 bytes} [Tue Jul 26 15:28:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:15.254900 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-252b32ff-7b69-417e-83a7-a98928b97e94 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:15.255919 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-252b32ff-7b69-417e-83a7-a98928b97e94 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001467 Jul 26 15:28:15.256308 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 25/48] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:15.796221 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-564596b8-3858-4a20-a0d8-04339fb88dcd admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:15.802142 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.wsgi [None req-564596b8-3858-4a20-a0d8-04339fb88dcd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-564596b8-3858-4a20-a0d8-04339fb88dcd admin admin] Request method failure captured: Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept: application/json Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Accept-Encoding: gzip, deflate Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Connection: keep-alive Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Content-Length: 0 Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Host: 10.222.0.128 Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Openstack-System-Scope: None Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: User-Agent: python-novaclient Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Auth-Token: gAAAAABi4AgP7UWCSavABMb_u5V0-uywzVyATBrCnIOpt_f2Abwudgl3jSZWXxhPKj2FiHye4ZsVr7_SRO_U6oGzCW_yNBQPRvITFNUXfRgPaROg6TJSQeWdUw5l4F5zajADnB0qYbL79sBFReJiWcm7a0Ey2aC3gzg6MQ_BX6YXJ47AGZe_c-w Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Id: None Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Domain-Name: None Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Identity-Status: Confirmed Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Is-Admin-Project: True Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Id: default Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Domain-Name: Default Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Project-Name: admin Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Role: member,reader,admin Jul 26 15:28:15.803641 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Roles: member,reader,admin Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant: admin Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-Tenant-Name: admin Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User: admin Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Id: default Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Domain-Name: Default Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: X-User-Name: admin Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: method: > Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: exception: Flavor 451 could not be found. Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: action_args: {'id': '451'} Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:15.805295 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:15.809418 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.810797 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-564596b8-3858-4a20-a0d8-04339fb88dcd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103831) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:15.812012 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-564596b8-3858-4a20-a0d8-04339fb88dcd admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408941 Jul 26 15:28:15.812012 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 24/49] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:28:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 15:28:15.815406 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-414ded31-f113-438d-8ebd-c17c66314369 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:15.830978 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-414ded31-f113-438d-8ebd-c17c66314369 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019164 Jul 26 15:28:15.833541 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 26/50] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:28:15.841566 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:15.857046 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019624 Jul 26 15:28:15.857581 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 25/51] 10.222.0.128 () {60 vars in 1215 bytes} [Tue Jul 26 15:28:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:28:15.866970 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-8da9107f-29f9-43d3-b0ff-40a4d584ea41 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:15.873112 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.wsgi [None req-8da9107f-29f9-43d3-b0ff-40a4d584ea41 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-8da9107f-29f9-43d3-b0ff-40a4d584ea41 admin admin] Request method failure captured: Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept: application/json Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Accept-Encoding: gzip, deflate Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Connection: keep-alive Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Content-Length: 0 Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Host: 10.222.0.128 Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-Api-Version: compute 2.90 Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Openstack-System-Scope: None Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: User-Agent: python-novaclient Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Auth-Token: gAAAAABi4AgP7UWCSavABMb_u5V0-uywzVyATBrCnIOpt_f2Abwudgl3jSZWXxhPKj2FiHye4ZsVr7_SRO_U6oGzCW_yNBQPRvITFNUXfRgPaROg6TJSQeWdUw5l4F5zajADnB0qYbL79sBFReJiWcm7a0Ey2aC3gzg6MQ_BX6YXJ47AGZe_c-w Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Id: None Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Domain-Name: None Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Identity-Status: Confirmed Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Is-Admin-Project: True Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Id: default Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Domain-Name: Default Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Project-Name: admin Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Role: member,reader,admin Jul 26 15:28:15.874616 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Roles: member,reader,admin Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/b15b339f34b0459888ba2e587e895d4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/b15b339f34b0459888ba2e587e895d4f"}]}] Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant: admin Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Id: b15b339f34b0459888ba2e587e895d4f Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-Tenant-Name: admin Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User: admin Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Id: default Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Domain-Name: Default Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Id: 7e2685b786dd4d2eb4cf48fedfc3b189 Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: X-User-Name: admin Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: method: > Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: exception: Flavor 451 could not be found. Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: action_args: {'id': '451'} Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:15.876272 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:15.877211 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: ERROR nova.api.openstack.wsgi Jul 26 15:28:15.878631 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-8da9107f-29f9-43d3-b0ff-40a4d584ea41 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:15.879910 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-8da9107f-29f9-43d3-b0ff-40a4d584ea41 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012701 Jul 26 15:28:15.879910 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 27/52] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:28:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 15:28:16.970125 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:16.971126 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 Jul 26 15:28:16.971518 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 26/53] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:17.499873 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-fa2bf373-89be-4ad5-ba22-a3951b54e1b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:17.585681 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-fa2bf373-89be-4ad5-ba22-a3951b54e1b5 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.476321 Jul 26 15:28:17.586240 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 28/54] 10.222.0.128 () {64 vars in 1240 bytes} [Tue Jul 26 15:28:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:18.588824 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:18.589770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002199 Jul 26 15:28:18.590161 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 27/55] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:19.114913 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-3551a6b3-ce44-41b2-81cd-4dc7d262ade9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:19.190129 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-3551a6b3-ce44-41b2-81cd-4dc7d262ade9 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.459592 Jul 26 15:28:19.190603 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 29/56] 10.222.0.128 () {64 vars in 1240 bytes} [Tue Jul 26 15:28:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:20.154610 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:20.155601 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001420 Jul 26 15:28:20.155985 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 28/57] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:20.688633 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-22fafe02-af61-4578-9960-9c043a35c237 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:20.768756 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-22fafe02-af61-4578-9960-9c043a35c237 admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.472460 Jul 26 15:28:20.769305 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 30/58] 10.222.0.128 () {64 vars in 1240 bytes} [Tue Jul 26 15:28:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:21.750228 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:21.751221 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001421 Jul 26 15:28:21.751634 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 29/59] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:22.289145 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-455bd28d-cf14-46db-abb7-7091b493aeab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:22.391597 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-455bd28d-cf14-46db-abb7-7091b493aeab admin admin] 10.222.0.128 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.500555 Jul 26 15:28:22.392159 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 31/60] 10.222.0.128 () {64 vars in 1240 bytes} [Tue Jul 26 15:28:21 2022] POST /compute/v2.1/flavors => generated 411 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:23.369632 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:23.370648 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002044 Jul 26 15:28:23.371040 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 30/61] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:28:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:23.899311 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-07f68224-a5f1-48e7-833e-d61982755133 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:23.920676 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-07f68224-a5f1-48e7-833e-d61982755133 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.411758 Jul 26 15:28:23.921219 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 32/62] 10.222.0.128 () {60 vars in 1207 bytes} [Tue Jul 26 15:28:23 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:29:17.094919 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.095918 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-c96b1ec5-c3ef-4f6f-a485-3e0155500b4b admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001428 Jul 26 15:29:17.096315 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 31/63] 10.222.0.128 () {54 vars in 935 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:29:17.108125 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:17.499579 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-55a91d96-4e49-4b76-a5a5-904dc928a0bc admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.519986 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-55a91d96-4e49-4b76-a5a5-904dc928a0bc admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.417110 Jul 26 15:29:17.520451 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 33/64] 10.222.0.128 () {60 vars in 1296 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:29:17.542719 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG dbcounter [-] [103831] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103831) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:17.546528 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-0c06abd8-1d52-4788-ac17-30086602b23b admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.554597 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-0c06abd8-1d52-4788-ac17-30086602b23b admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013299 Jul 26 15:29:17.555117 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 32/65] 10.222.0.128 () {60 vars in 1287 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:17.566629 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-1aeee3f9-2be9-4e53-8829-f705936b6b33 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.575407 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-1aeee3f9-2be9-4e53-8829-f705936b6b33 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012284 Jul 26 15:29:17.575931 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 34/66] 10.222.0.128 () {60 vars in 1290 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:29:17.588195 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.596323 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012724 Jul 26 15:29:17.596882 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 33/67] 10.222.0.128 () {60 vars in 1290 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:17.612096 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-8aad15a1-d277-494c-bf4b-9ff2d5977167 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.621240 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-8aad15a1-d277-494c-bf4b-9ff2d5977167 admin admin] 10.222.0.128 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013033 Jul 26 15:29:17.621809 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 35/68] 10.222.0.128 () {60 vars in 1287 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:02.093595 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:02.094611 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Jul 26 15:33:02.095029 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 34/69] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:33:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:02.239514 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_api:SELECT=6 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:02.404852 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:02.407127 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:33:02.407127 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:33:02.408335 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:02.408842 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:02.409683 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:02.410217 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:02.446651 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-feb49909-53dd-491e-bb47-2fb4d5fb8a68 admin admin] 10.222.0.128 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208877 Jul 26 15:33:02.447220 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 36/70] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:33:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:33:03.391605 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:03.392643 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Jul 26 15:33:03.393036 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 35/71] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:33:03 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:03.593946 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:03.596423 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:33:03.596423 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:33:03.597593 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:03.598038 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:03.598818 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:03.599345 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:03.620012 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-fb1d2add-1474-47d8-9ca5-0d74d3b9814b admin admin] 10.222.0.128 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080202 Jul 26 15:33:03.620598 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 37/72] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:33:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:33:14.887730 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:14.888770 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001456 Jul 26 15:33:14.889164 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 36/73] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:33:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:15.035740 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_cell0:SELECT=4 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:15.036483 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_cell1:SELECT=4 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:15.037102 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG dbcounter [-] [103830] Writing DB stats nova_api:SELECT=8 {{(pid=103830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:15.087292 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:15.089873 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:33:15.089873 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:33:15.091104 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:15.091553 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:15.092380 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:15.092863 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:15.119556 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-f5ee8763-6e8b-46f1-a017-036f0b51155e admin admin] 10.222.0.128 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088117 Jul 26 15:33:15.120118 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 38/74] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:33:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:33:15.972118 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: DEBUG nova.api.openstack.wsgi [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] Calling method '>' {{(pid=103831) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:15.972860 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: INFO nova.api.openstack.requestlog [None req-6b472369-22af-4af7-bac4-563788a48803 admin admin] 10.222.0.128 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001419 Jul 26 15:33:15.973253 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: [pid: 103831|app: 0|req: 37/75] 10.222.0.128 () {56 vars in 1079 bytes} [Tue Jul 26 15:33:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:33:16.170795 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG nova.api.openstack.wsgi [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] Calling method '>' {{(pid=103830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:16.173200 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:33:16.173200 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: warnings.warn(msg) Jul 26 15:33:16.174420 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:16.174852 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:16.175627 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:16.176046 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: DEBUG oslo_concurrency.lockutils [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:16.199607 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: INFO nova.api.openstack.requestlog [None req-f89dae22-4cac-43cf-9e0c-ef8f9be18f8c admin admin] 10.222.0.128 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084528 Jul 26 15:33:16.200180 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: [pid: 103830|app: 0|req: 39/76] 10.222.0.128 () {60 vars in 1198 bytes} [Tue Jul 26 15:33:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:34:15.238113 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: Tue Jul 26 15:34:15 2022 - graceful shutdown triggered... Jul 26 15:34:15.238003 dv-cinder-851032-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 15:34:15.240424 dv-cinder-851032-1-iscsi devstack@n-api.service[103831]: Gracefully killing worker 2 (pid: 103831)... Jul 26 15:34:15.240950 dv-cinder-851032-1-iscsi devstack@n-api.service[103830]: Gracefully killing worker 1 (pid: 103830)... Jul 26 15:34:16.239055 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: worker 1 buried after 1 seconds Jul 26 15:34:16.239628 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: worker 2 buried after 1 seconds Jul 26 15:34:16.239628 dv-cinder-851032-1-iscsi devstack@n-api.service[103829]: goodbye to uWSGI. Jul 26 15:34:16.240729 dv-cinder-851032-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 15:34:16.241320 dv-cinder-851032-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 15:34:16.244320 dv-cinder-851032-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 15:34:16.255963 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 15:34:16 2022] *** Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: nodename: dv-cinder-851032-1-iscsi Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: machine: x86_64 Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: clock source: unix Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: pcre jit disabled Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: detected number of CPU cores: 4 Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: current working directory: / Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: detected binary path: /usr/bin/uwsgi-core Jul 26 15:34:16.258067 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: your processes number limit is 47680 Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: your memory page size is 4096 bytes Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: detected max file descriptor number: 2048 Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: lock engine: pthread robust mutexes Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: thunder lock: enabled Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 15:34:16.258793 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 15:34:16.302134 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: Python main interpreter initialized at 0x55e5121839c0 Jul 26 15:34:16.302134 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: python threads support enabled Jul 26 15:34:16.302134 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: your server socket listen backlog is limited to 100 connections Jul 26 15:34:16.302134 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: your mercy for graceful operations on workers is 90 seconds Jul 26 15:34:16.302618 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 15:34:16.302618 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: *** Operational MODE: preforking *** Jul 26 15:34:16.302865 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: *** uWSGI is running in multiple interpreter mode *** Jul 26 15:34:16.302865 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: spawned uWSGI master process (pid: 124824) Jul 26 15:34:16.303076 dv-cinder-851032-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 15:34:16.305350 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: spawned uWSGI worker 1 (pid: 124842, cores: 1) Jul 26 15:34:16.305350 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: spawned uWSGI worker 2 (pid: 124843, cores: 1) Jul 26 15:34:16.305350 dv-cinder-851032-1-iscsi devstack@n-api.service[124824]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 15:34:16.975937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:34:17.013324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 15:34:18.146009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:34:18.146009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: from cryptography.utils import int_from_bytes Jul 26 15:34:18.146628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:34:18.146628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: from cryptography.utils import int_from_bytes Jul 26 15:34:18.186713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:34:18.186713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: from cryptography.utils import int_from_bytes Jul 26 15:34:18.187307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:34:18.187307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: from cryptography.utils import int_from_bytes Jul 26 15:34:20.609310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:34:20.610219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:34:20.610219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:34:20.610507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:34:20.610713 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:34:20.611293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.611450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.611743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.612040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.612348 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.612692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.613597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.613940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.614268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.614526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.614843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.615168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851032-1-iscsi {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.615489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.615979 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.616293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.616649 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.616955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.617280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.617585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.618097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.620339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851032-1-iscsi {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.622134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.623347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.623347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.623832 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.624106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.624426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.624920 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.625418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.625801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.626387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.626677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.627200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.627686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.628157 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.628702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.629893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.629893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.632161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.632161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.632161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.632161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.632161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.633193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.633193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.633473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.633710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.634132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.634605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.635067 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.635509 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.635942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.636524 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.636941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.637451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.637955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.638482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.639029 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.639551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.640106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.640665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.641203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.641865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.128 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.642274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.128 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.642773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.643331 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.643863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.644431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.645192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.645745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.646289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.646777 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.647446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.647641 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:34:20.648125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:34:20.648301 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.648458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:34:20.648641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.648797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:34:20.648944 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:34:20.649098 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.649244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.649397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.649550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.649833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.649991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.650163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.650442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.650704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.650905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.651975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.652126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.652285 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.652571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.652730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851032-1-iscsi {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.652942 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.653093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.653400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.653571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.653717 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654174 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.654952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.655115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.655565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.655776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.655776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.656116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.656358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.656358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.658821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.658995 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.659158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.659321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.659476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.659639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.659796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.660618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.660772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.660926 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661238 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661547 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.661859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851032-1-iscsi {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662017 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662161 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.662917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663669 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.663976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.664915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.665068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.665228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.665640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.665640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.665947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.666983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.667890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.668062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.668375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.668575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.668885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669498 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.669965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670591 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.670889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.671796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.671940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.672097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.672261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.672261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.672579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.672729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.672873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.673026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.673171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.673324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.673477 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.673623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.673786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.673941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.674087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.674249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.674402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.674565 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.674730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.674730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.675022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.128 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.675022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.128 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.675303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.676286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.676568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.676815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.677011 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.677178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.677333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.677479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.677637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.677783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.677937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.678093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.678246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.678585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.678737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.679083 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.679246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.679401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.679558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.679722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.679868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.680020 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.680168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.680312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.680312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.680666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.680823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.680976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.681134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.681280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.681433 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.681599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.681752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.681898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.682173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.682349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.682497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.682651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.682803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.682948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.683092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.683245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.683413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.683568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.683724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.683867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.684020 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.684181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.684343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.684516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.684694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.684851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.685004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.685149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.685310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.685466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.685637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.685790 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.685943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.686099 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.686489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.686489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.686792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.687014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.687165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.687325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.687481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.687627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.687787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.687951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.688107 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.688253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.688409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.688808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.688994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.689304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.689466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.689620 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.689766 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.689920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.690086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.690242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.690410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.690570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.690717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.690868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.691023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.691259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.691450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.691598 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.691743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.691887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.692040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.692197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.692343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.692530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.692685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.692830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.692983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.693138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.693284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.693429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.693573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.693726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.693882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.694036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.694190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.694335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.694489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.694653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.694811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.694964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.695117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.695263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.695407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.695550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.695708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.695855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.696007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.696160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.696344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.696811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.697005 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.697240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:34:20.697392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.697537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.697681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.697681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.698075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.698228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.698373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.698373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.698664 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.699010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.699176 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.699512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.699683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.699939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700272 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.700889 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701572 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.701863 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702027 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.702915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.703879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.704173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.704318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.704490 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.704648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.704877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.705025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.705170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.705170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.705456 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.705614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.706029 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.706180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.706326 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.706470 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.706613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.707314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.707565 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.707728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.707876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.708115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.708279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.708440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.708655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.708815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.709146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.709309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.710376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.710544 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.710699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.710846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.711831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712336 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.712976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.713879 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.714824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715280 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715742 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.715895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.716861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.717237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.717484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.717770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.717925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.718976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.719328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.719488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.719737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.719899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.720102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.720269 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.720573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.720772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.720933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.721099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.721256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.721648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.721806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.721960 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.722116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.722270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.723057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.723313 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.723551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.724994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725459 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.725987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.726991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727696 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.727936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728560 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.728926 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729576 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729576 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729764 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729850 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.729945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730040 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.730995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731372 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.731996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732218 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732369 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.732898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.733959 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734837 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.734929 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735014 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735097 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735463 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.735995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.736960 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.737939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.738138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.738896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.739927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.740088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.740236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.740397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.740638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741048 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.741990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.742839 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743455 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.743973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.744911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745325 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.745968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.746908 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747832 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.747954 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748051 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.748986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749069 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.749999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.750914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751340 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751604 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.751997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.752200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.752303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.752570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.752891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.753207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.753383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.753609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.753863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.754074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.754315 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.754636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.754942 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.755262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.755585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756621 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.756943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.757950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758266 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758795 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.758886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759120 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759227 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.759929 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.760893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.761974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.762227 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.762420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.762568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.762730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.762891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763533 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.763965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.764925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.765987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766165 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.766922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767554 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767768 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.767861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768091 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768185 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768599 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.768841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.769913 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.770085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.770220 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.770374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.770683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771277 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.771917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772492 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772591 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.772901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.773834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774045 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.774968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775059 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775587 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.775988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776533 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776644 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.776946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777594 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.777883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.778813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779012 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.779938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780555 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.780907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781641 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.781996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.782908 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783355 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.783966 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.784120 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.784271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.784422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.784555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.784778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.785400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.785630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.785787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.785948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.786106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.786375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.786546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.786688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.786903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787447 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.787918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.788980 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789302 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.789952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.790197 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.790366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.790626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.790793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.790947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.791737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.792850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.793014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.793014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.793365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.793676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.793910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794249 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794674 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.794910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795338 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.795984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.796191 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.796291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.796546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.796693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.796879 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797329 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797858 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.797980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.798169 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.798300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.798503 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.798595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.798879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.799926 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.800081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.800195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.800327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.801245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.801389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.801665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.801997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.802314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.802772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.802962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.803880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804415 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804647 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.804993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.805991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.806987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.807965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808303 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808748 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.808971 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809290 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.809946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.810091 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.810281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.810408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.810718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.810824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811691 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.811955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812415 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.812902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813446 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.813856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814362 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.814987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815712 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.815921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.816017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.816273 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.816395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.816595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.816940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.817903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.818072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.818224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.818605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.818720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.818830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819109 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.819822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820682 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.820793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821336 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.821975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822296 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.822927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.823908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824447 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.824964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.825864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.826793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827433 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827675 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827858 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.827992 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828410 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828644 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.828969 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.829993 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.830136 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.830262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.830377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.830558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.830688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.831138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.831270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.831446 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.831575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.832928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833084 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833550 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.833909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834498 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.834992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835756 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.835942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.836976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.837937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.838919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839433 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839534 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.839833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.840787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.841982 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.842890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.843134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.843451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.843574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.843775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.843872 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844765 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.844880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845088 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.845845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846059 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.846973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.847162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.847260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.848110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.848268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.848427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.848633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.848841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.849861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850191 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.850881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.851946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852455 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852590 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.852888 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.853820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.854998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.855925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.856026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.856262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.856361 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.856792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.856895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857386 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.857849 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858156 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.858947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.859141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.859355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.859527 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.859701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.859861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860011 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860267 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.860845 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861039 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.861772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.862880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863620 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.863983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.864133 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.864373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.864499 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.864737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.864852 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865057 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.865785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.866962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867277 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867394 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.867988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868675 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.868972 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869189 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.869925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870136 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.870871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871691 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.871803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872012 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.872983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873301 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873716 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.873933 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874265 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874875 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.874975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875608 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.875928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876582 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.876903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877382 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.877951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.878157 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.878269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.878514 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.878630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.878852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879523 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.879952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880345 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.880823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.881964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882067 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882265 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882357 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882597 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882679 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.882918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.883948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.884170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.884270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.884493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.884626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.884962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.885284 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.885611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.885907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.885996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.886997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887331 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.887996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.888188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.888323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.888642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.888740 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889032 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.889906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890524 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.890854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.891834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892691 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.892780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893102 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.893948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.894042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.894853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.894999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895190 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895361 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.895926 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.896930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897266 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.897930 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.898860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.899866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.900130 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:34:20.900269 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.900388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.900728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.901042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.901354 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.901714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.901979 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.902293 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.902608 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.902920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.903232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.903543 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.903884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.904224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.904571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.904906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.905228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.905560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.905876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.906207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.906536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.906869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.907190 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.907528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.907847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.908164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.908500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.908830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.909146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.909465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.909895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.910893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.911222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.911573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.911911 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.912217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.912569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.912893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.914080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.914493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.914738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.915064 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.915390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.915714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.916047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.916379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.916728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.917066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.917507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.917845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.918182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.918509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.918845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.920977 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.921187 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.921500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:34:20.921749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124842) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:34:20.962916 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Registered counter for database nova_api Jul 26 15:34:20.985423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO dbcounter [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Registered counter for database nova_api Jul 26 15:34:20.985944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:20.993775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.007493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_db.sqlalchemy.engines [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.014636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writer thread running {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.055662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.context [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06f98f67-0c8d-404d-9439-56d0670c1f78(cell1) {{(pid=124843) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:34:21.059903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:21.061462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:21.062287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:21.065883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:21.068666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Registered counter for database nova_cell0 Jul 26 15:34:21.071166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Registered counter for database nova_cell1 Jul 26 15:34:21.074799 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.context [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),06f98f67-0c8d-404d-9439-56d0670c1f78(cell1) {{(pid=124842) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 15:34:21.078127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.079278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:21.081240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:21.082800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:21.083757 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.085183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:21.087275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO dbcounter [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Registered counter for database nova_cell0 Jul 26 15:34:21.091585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO dbcounter [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Registered counter for database nova_cell1 Jul 26 15:34:21.101702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_db.sqlalchemy.engines [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.102927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_db.sqlalchemy.engines [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.109952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writer thread running {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.111248 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writer thread running {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.229668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.234752 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.247727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Registered counter for database nova_cell0 Jul 26 15:34:21.255413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.260332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.263616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO dbcounter [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Registered counter for database nova_cell0 Jul 26 15:34:21.272773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_db.sqlalchemy.engines [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124842) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:34:21.277423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writer thread running {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:34:21.575794 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:34:21.583922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:34:21.603225 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: WARNING keystonemiddleware.auth_token [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:34:21.610524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: WARNING keystonemiddleware.auth_token [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:34:21.925052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:34:21.931429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-744c3bfc-bd71-45cd-a95d-0a4aaaa61b25 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:34:21.936911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e5121839c0 pid: 124843 (default app) Jul 26 15:34:21.959058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: WARNING keystonemiddleware.auth_token [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 15:34:21.965231 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: WARNING keystonemiddleware.auth_token [None req-0d75bc37-28ad-4ef8-bdf2-8bf48abac9f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 15:34:21.970636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e5121839c0 pid: 124842 (default app) Jul 26 15:35:05.389792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:05.392320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:05.392320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:05.393109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:06.948500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-11c9a8d8-59fa-4755-81ff-59312b2b7b12 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Action: 'create', calling method: .version_select at 0x7f3470be3940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-385543322"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:09.095341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-11c9a8d8-59fa-4755-81ff-59312b2b7b12 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.714863 Jul 26 15:35:09.105415 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 1/1] 10.222.0.128 () {60 vars in 1160 bytes} [Tue Jul 26 15:35:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3719 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 26 15:35:09.620013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b4bce581-cae6-4833-a488-bb86bb899ce2 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470c934c0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:09.649600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:09.650377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:09.651633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:09.652544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:10.108332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b4bce581-cae6-4833-a488-bb86bb899ce2 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 200 len: 344 microversion: 2.1 time: 0.998402 Jul 26 15:35:10.109328 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 1/2] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:35:09 2022] GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 344 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:11.124180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e084a0bf-0e45-4f64-a009-5967dc714da4 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a38790>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:11.185233 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e084a0bf-0e45-4f64-a009-5967dc714da4 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 200 len: 345 microversion: 2.1 time: 0.065177 Jul 26 15:35:11.193829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 2/3] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:35:11 2022] GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:11.207552 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-57a896bb-feb5-4e9d-bc1f-3c579fe0790f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Action: 'create', calling method: .version_select at 0x7f3470aec8b0>, body: {"snapshot": {"volume_id": "41d3ae83-7137-458b-9156-1a976a9b8b6a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1342762880"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:12.174993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-57a896bb-feb5-4e9d-bc1f-3c579fe0790f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.979946 Jul 26 15:35:12.177155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 2/4] 10.222.0.128 () {60 vars in 1167 bytes} [Tue Jul 26 15:35:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:12.190272 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4a4dc2e3-aa49-4771-9a27-02a4f46d8d81 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a38e50>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:12.347963 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4a4dc2e3-aa49-4771-9a27-02a4f46d8d81 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.163039 Jul 26 15:35:12.348559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 3/5] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:12 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:12.365184 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c3ec6b65-3f4c-4d89-bbe7-c4fef1623856 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470aec940>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:12.721647 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c3ec6b65-3f4c-4d89-bbe7-c4fef1623856 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.366085 Jul 26 15:35:12.729075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 3/6] 10.222.0.128 () {58 vars in 1145 bytes} [Tue Jul 26 15:35:12 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:12.735513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-527d16a1-f82a-409c-9efc-9925ac078ac4 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a505e0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:12.805977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-527d16a1-f82a-409c-9efc-9925ac078ac4 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.073773 Jul 26 15:35:12.805977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 4/7] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:12 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:13.832767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9d22c21d-f6e6-4f3a-904f-cbaea0f954cf tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a49a60>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:13.880049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9d22c21d-f6e6-4f3a-904f-cbaea0f954cf tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.062993 Jul 26 15:35:13.891562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 4/8] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:13 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:14.902881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-86ecbd65-15cc-41fc-93c4-d8aadd2237ed tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a38d30>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:14.971621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-86ecbd65-15cc-41fc-93c4-d8aadd2237ed tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.075584 Jul 26 15:35:14.973021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 5/9] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:14 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:15.984929 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2be69f25-dfbd-4fe1-a94a-b9cfb2cc5f5a tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a501f0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:16.031923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2be69f25-dfbd-4fe1-a94a-b9cfb2cc5f5a tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 288 microversion: 2.1 time: 0.051383 Jul 26 15:35:16.040846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 5/10] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:15 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 288 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:16.051365 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f12c5b7d-1a33-4707-a22e-06b4bad7b4d1 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a38670>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:16.200441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f12c5b7d-1a33-4707-a22e-06b4bad7b4d1 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "DELETE /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 202 len: 0 microversion: 2.1 time: 0.159817 Jul 26 15:35:16.201060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 6/11] 10.222.0.128 () {58 vars in 1259 bytes} [Tue Jul 26 15:35:16 2022] DELETE /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:35:16.210709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-297fff78-7f9d-4bc0-99a3-573b10c86347 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a49820>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:16.278909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-297fff78-7f9d-4bc0-99a3-573b10c86347 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.072038 Jul 26 15:35:16.279754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 6/12] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:16 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:17.295819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7559213a-35dd-42fc-90a3-c8cbb5d510e2 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a503a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:17.370113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7559213a-35dd-42fc-90a3-c8cbb5d510e2 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.079946 Jul 26 15:35:17.370819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 7/13] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:17 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:18.383945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8e085273-81d6-4ec1-a5b3-622dd051300e tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a491f0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:18.437051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8e085273-81d6-4ec1-a5b3-622dd051300e tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 200 len: 287 microversion: 2.1 time: 0.057485 Jul 26 15:35:18.440033 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 7/14] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:18 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:19.455402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c151fe51-1c35-49ac-99fa-5ee2cd8623fb tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470a38940>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:19.500822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-c151fe51-1c35-49ac-99fa-5ee2cd8623fb tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] HTTP exception thrown: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c151fe51-1c35-49ac-99fa-5ee2cd8623fb tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Request method failure captured: Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d HTTP/1.1 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AmpX3C6v-_siR7b2Yelh1DPs62GspBQ6de6b0asP0yVBshgKygphJT2i7MUQFDh71Dhk9N0jSDoCvDJiiZGkc6MejTRVj8wlQUfBYYJLVGI3_jKvtIVav0o3djOxwP1XfQm82-8ose77i5j-mBOILbTaszo2KOHp1DpgjaXbcWUc6Q Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:35:19.505590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_03338c8787e749e38b882038a546a408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/03338c8787e749e38b882038a546a408"}]}] Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: f31c861cbc294353b79ed18658fe1236 Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '0a7a636f-410e-44b9-ab1e-5acf914dcb5d'} Jul 26 15:35:19.506808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. (HTTP 404) (Request-ID: req-bb4238c9-edf4-4449-9aa0-3692f282a38e) Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.507519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:19.508419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 15:35:19.509488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c151fe51-1c35-49ac-99fa-5ee2cd8623fb tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Returning 404 to user: Snapshot 0a7a636f-410e-44b9-ab1e-5acf914dcb5d could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:35:19.510443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c151fe51-1c35-49ac-99fa-5ee2cd8623fb tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d" status: 404 len: 111 microversion: 2.1 time: 0.057341 Jul 26 15:35:19.511841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 8/15] 10.222.0.128 () {58 vars in 1256 bytes} [Tue Jul 26 15:35:19 2022] GET /compute/v2.1/os-snapshots/0a7a636f-410e-44b9-ab1e-5acf914dcb5d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:35:19.522989 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8c670907-f17c-4aae-8412-2373a5951fb5 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470aec670>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:19.873680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8c670907-f17c-4aae-8412-2373a5951fb5 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 202 len: 0 microversion: 2.1 time: 0.355358 Jul 26 15:35:19.874530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 8/16] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:35:19 2022] DELETE /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:35:19.883723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4b2b226b-31b0-4f13-b40b-7428d48acb06 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f347140ce50>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:20.010641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4b2b226b-31b0-4f13-b40b-7428d48acb06 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 200 len: 344 microversion: 2.1 time: 0.131561 Jul 26 15:35:20.011498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 9/17] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:35:19 2022] GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:21.031227 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7dfb61e1-11fb-478f-ade9-8e7247ee8df8 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f3470aec940>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:21.112440 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-7dfb61e1-11fb-478f-ade9-8e7247ee8df8 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] HTTP exception thrown: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7dfb61e1-11fb-478f-ade9-8e7247ee8df8 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Request method failure captured: Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a HTTP/1.1 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AmpX3C6v-_siR7b2Yelh1DPs62GspBQ6de6b0asP0yVBshgKygphJT2i7MUQFDh71Dhk9N0jSDoCvDJiiZGkc6MejTRVj8wlQUfBYYJLVGI3_jKvtIVav0o3djOxwP1XfQm82-8ose77i5j-mBOILbTaszo2KOHp1DpgjaXbcWUc6Q Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:35:21.119086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_03338c8787e749e38b882038a546a408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/03338c8787e749e38b882038a546a408"}]}] Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: f31c861cbc294353b79ed18658fe1236 Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '41d3ae83-7137-458b-9156-1a976a9b8b6a'} Jul 26 15:35:21.120422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. (HTTP 404) (Request-ID: req-2187b30c-7262-49df-96c3-9f172fd36c83) Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.121242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:21.122152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:35:21.123132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7dfb61e1-11fb-478f-ade9-8e7247ee8df8 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Returning 404 to user: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:35:21.124002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7dfb61e1-11fb-478f-ade9-8e7247ee8df8 tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 404 len: 109 microversion: 2.1 time: 0.093779 Jul 26 15:35:21.125384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 9/18] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:35:21 2022] GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:35:21.138399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69f1daab-083b-492d-9c35-0eb09c8bd51f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f34709b60d0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:21.212076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-69f1daab-083b-492d-9c35-0eb09c8bd51f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] HTTP exception thrown: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69f1daab-083b-492d-9c35-0eb09c8bd51f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Request method failure captured: Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a HTTP/1.1 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AmpX3C6v-_siR7b2Yelh1DPs62GspBQ6de6b0asP0yVBshgKygphJT2i7MUQFDh71Dhk9N0jSDoCvDJiiZGkc6MejTRVj8wlQUfBYYJLVGI3_jKvtIVav0o3djOxwP1XfQm82-8ose77i5j-mBOILbTaszo2KOHp1DpgjaXbcWUc6Q Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:35:21.214463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_03338c8787e749e38b882038a546a408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/03338c8787e749e38b882038a546a408"}]}] Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: f31c861cbc294353b79ed18658fe1236 Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '41d3ae83-7137-458b-9156-1a976a9b8b6a'} Jul 26 15:35:21.215663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. (HTTP 404) (Request-ID: req-7da64dfc-42bd-49e1-a01e-95f7e286562d) Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.216556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:35:21.217564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:35:21.219542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69f1daab-083b-492d-9c35-0eb09c8bd51f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Returning 404 to user: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-69f1daab-083b-492d-9c35-0eb09c8bd51f tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 404 len: 109 microversion: 2.1 time: 0.081407 Jul 26 15:35:21.220898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 10/19] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:35:21 2022] DELETE /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:35:21.225451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6531b141-c434-493e-90ce-104d93b80aef tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Calling method '.version_select at 0x7f347140d790>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:21.298425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-6531b141-c434-493e-90ce-104d93b80aef tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] HTTP exception thrown: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6531b141-c434-493e-90ce-104d93b80aef tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Request method failure captured: Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a HTTP/1.1 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AmpX3C6v-_siR7b2Yelh1DPs62GspBQ6de6b0asP0yVBshgKygphJT2i7MUQFDh71Dhk9N0jSDoCvDJiiZGkc6MejTRVj8wlQUfBYYJLVGI3_jKvtIVav0o3djOxwP1XfQm82-8ose77i5j-mBOILbTaszo2KOHp1DpgjaXbcWUc6Q Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:35:21.300573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_03338c8787e749e38b882038a546a408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/03338c8787e749e38b882038a546a408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/03338c8787e749e38b882038a546a408"}]}] Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 03338c8787e749e38b882038a546a408 Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1144559027 Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: f31c861cbc294353b79ed18658fe1236 Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1144559027-project Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '41d3ae83-7137-458b-9156-1a976a9b8b6a'} Jul 26 15:35:21.306438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. (HTTP 404) (Request-ID: req-97c008d2-e32a-48b0-ab0a-0e58ab7cde7a) Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.307664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:35:21.308723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:35:21.310031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6531b141-c434-493e-90ce-104d93b80aef tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] Returning 404 to user: Volume 41d3ae83-7137-458b-9156-1a976a9b8b6a could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6531b141-c434-493e-90ce-104d93b80aef tempest-VolumesSnapshotsTestJSON-1144559027 tempest-VolumesSnapshotsTestJSON-1144559027-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a" status: 404 len: 109 microversion: 2.1 time: 0.080949 Jul 26 15:35:21.311116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 10/20] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:35:21 2022] GET /compute/v2.1/os-volumes/41d3ae83-7137-458b-9156-1a976a9b8b6a => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:35:23.093824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-890437081", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:23.414228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] validate_networks() for [('3b2c9ca8-7a56-40ff-881c-039976281dd4', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:23.528481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e51ae4a0-b01a-4ec0-bc28-d618ed0368fb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: .version_select at 0x7f3470a49ca0>, body: {"keypair": {"name": "tempest-keypair-1653637068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSqtxR+F2VirrWB5brvm0ltu/O+nqqYc0jCcVkx1o6DB981wUmwJOQiQhCjj2uEqQlwj09fb8EXm5qEwU4tSOkwUPBQLI6JTZo0cVo+928Uq3UIWmOc+GJlVO0b6PP2Cw=="}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:23.588013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-e51ae4a0-b01a-4ec0-bc28-d618ed0368fb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for project 1165baf67df0484dbe4163c5a750784a. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:23.595690 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-e51ae4a0-b01a-4ec0-bc28-d618ed0368fb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for user e2e9553297c842b3a3c308cdd09aad8d and project 1165baf67df0484dbe4163c5a750784a. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:23.809271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e51ae4a0-b01a-4ec0-bc28-d618ed0368fb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.411621 Jul 26 15:35:23.819798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 11/21] 10.222.0.128 () {62 vars in 1205 bytes} [Tue Jul 26 15:35:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 424 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:35:26.021549 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8174fb0a-4a19-4ea0-9d15-0af38c4c9626 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: .version_select at 0x7f3470979790>, body: {"keypair": {"name": "tempest-keypair-617595212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5UyZ0S2HB+q60VYkREShWiEmPUWragmJH8B2tE9pj2IsM85BcO5bZPqJVqcrOva9vv1/rKw9+HC2FI3eEvLboTQ8ZuuZRt4J8qY7Kodx7SL3Q6YrvKpryBOfJtnXJYSA=="}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:26.104757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-8174fb0a-4a19-4ea0-9d15-0af38c4c9626 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:26.111339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-8174fb0a-4a19-4ea0-9d15-0af38c4c9626 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:26.345516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8174fb0a-4a19-4ea0-9d15-0af38c4c9626 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.197696 Jul 26 15:35:26.345926 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 12/22] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:35:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:26.501380 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:26.501888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:26.502456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:26.503084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:26.503700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:26.545866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:26.553449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:26.555010 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:26.558036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:26.669978 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:26.695060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fe0b0184-b964-42d2-93a0-800a215432d1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: .version_select at 0x7f34701371f0>, body: {"keypair": {"name": "tempest-keypair-152246200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtb1u+ACYvr2a78OMWJ6cdy1cGP71obxx1qBSFElfj8XGLWwCM5ZuX8cNRg+Vb0tqEyqaqHzPdcMvnDljMwWrK1g9a6423oiNK/gKpLQoD5N6jGrKO/l6Ac4U4uDXqqPA=="}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:26.696849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for user c2bf7ea384a142d1bc23b23ab503fca0 and project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:26.730369 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:26.733338 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:26.740923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-fe0b0184-b964-42d2-93a0-800a215432d1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for project f81499626e98449897622291738f07f7. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:26.758916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-fe0b0184-b964-42d2-93a0-800a215432d1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for user c2e3c15511fe433a9278248c528c86e0 and project f81499626e98449897622291738f07f7. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:26.887082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fe0b0184-b964-42d2-93a0-800a215432d1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.539591 Jul 26 15:35:26.887634 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 13/23] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:35:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:27.011744 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b28e76bc-52af-4476-91d6-7618e157fb8a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.447930 Jul 26 15:35:27.013594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 11/24] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:35:22 2022] POST /compute/v2.1/servers => generated 385 bytes in 4450 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:35:27.026837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ec4f6431-00a0-45fb-b5d5-c06db5cee1bc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:27.030365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ec4f6431-00a0-45fb-b5d5-c06db5cee1bc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:27.432633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec4f6431-00a0-45fb-b5d5-c06db5cee1bc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:27.461939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ec4f6431-00a0-45fb-b5d5-c06db5cee1bc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1225 microversion: 2.1 time: 0.439466 Jul 26 15:35:27.481812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 14/25] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:27 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1225 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:27.959857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1067202397", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:28.072270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] validate_networks() for [('3b2c9ca8-7a56-40ff-881c-039976281dd4', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:28.543379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-86664626", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "networks": [{"uuid": "2be0a9bc-b9da-4308-9564-233a11170d03"}]}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:28.797516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] validate_networks() for [('2be0a9bc-b9da-4308-9564-233a11170d03', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:31.147022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:31.147959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:31.148801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:31.149360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:31.149918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:31.177910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:31.178375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:31.179184 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:31.185692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:31.221670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:31.232310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for user c2bf7ea384a142d1bc23b23ab503fca0 and project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:31.283332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:31.300377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:31.486724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8c2eb397-50ef-4fe8-bada-1bd43b091ee7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.532080 Jul 26 15:35:31.493325 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 12/26] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:35:27 2022] POST /compute/v2.1/servers => generated 385 bytes in 3539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:35:31.498289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-06099281-5c87-4aba-8e58-f360bfe3e75f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:31.499580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-06099281-5c87-4aba-8e58-f360bfe3e75f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:31.737936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-06099281-5c87-4aba-8e58-f360bfe3e75f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:31.771029 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-06099281-5c87-4aba-8e58-f360bfe3e75f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1226 microversion: 2.1 time: 0.271464 Jul 26 15:35:31.772810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 13/27] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:31 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1226 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:32.775830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1277709932", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8f586bd-fa08-43ea-8187-a7c90e05c8af"}], "security_groups": [{"name": "tempest-securitygroup--202431111"}], "key_name": "tempest-keypair-1653637068", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:33.165036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] validate_networks() for [('c8f586bd-fa08-43ea-8187-a7c90e05c8af', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:33.633223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:33.633778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:33.634121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:33.634532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:33.635555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:33.660887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:33.660887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:33.660887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:33.660887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:33.695043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Getting quotas for project 417b9d6cde90467ebe75c790867a8c89. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:33.702333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Getting quotas for user 858548bfa9b7455cb518849f31471865 and project 417b9d6cde90467ebe75c790867a8c89. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:33.719172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:33.723659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:33.973720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-78038cae-4adc-496b-8158-f6b88cdf0559 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.793555 Jul 26 15:35:33.981812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 15/28] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:35:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 5802 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:35:33.990816 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:33.993748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:34.016167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:34.020580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:34.024992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:34.024992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:34.676307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:34.677526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:34.678292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:34.678840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:34.680360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:34.696394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:34.697117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:34.698239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:34.699374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:34.731180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for project 1165baf67df0484dbe4163c5a750784a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:34.737865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for user e2e9553297c842b3a3c308cdd09aad8d and project 1165baf67df0484dbe4163c5a750784a. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:34.749108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:34.760350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:34.765455 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e31de8d7-a18f-4a43-a0f1-7562e530cc44 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1230 microversion: 2.1 time: 0.781852 Jul 26 15:35:34.768700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:34.781170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 16/29] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:33 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1230 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:34.781170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-402b60ab-d0f4-42cd-9128-915107c2ce06 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:34.781170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-402b60ab-d0f4-42cd-9128-915107c2ce06 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:34.919913 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-402b60ab-d0f4-42cd-9128-915107c2ce06 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:34.939260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-402b60ab-d0f4-42cd-9128-915107c2ce06 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1217 microversion: 2.1 time: 0.166852 Jul 26 15:35:34.949215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 17/30] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:34 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:35.013834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eaaea83c-6765-46d3-a309-6be640baf4a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 2.242354 Jul 26 15:35:35.028496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 14/31] 10.222.0.128 () {62 vars in 1193 bytes} [Tue Jul 26 15:35:32 2022] POST /compute/v2.1/servers => generated 403 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jul 26 15:35:35.029258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:35.030458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:35.596209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:35.604972 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:35.612767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:35.613965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-415bb079-b8c5-4462-b63c-1948db4ca9a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1286 microversion: 2.20 time: 0.588597 Jul 26 15:35:35.626818 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 18/32] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:35 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1286 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:35.791479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:35.792785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:35.814078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:35.814078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:35.814078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:35.814405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:35.966574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0f345653-deb4-43ef-b6a6-6b7f1ebcd488 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:35.968800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0f345653-deb4-43ef-b6a6-6b7f1ebcd488 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:36.268833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0f345653-deb4-43ef-b6a6-6b7f1ebcd488 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:36.281699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0f345653-deb4-43ef-b6a6-6b7f1ebcd488 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1217 microversion: 2.1 time: 0.321422 Jul 26 15:35:36.295951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 19/33] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:35 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1217 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:36.641249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:36.641951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:36.755236 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:36.766046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:36.769085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:36.771346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3ba5e432-c61a-4f9c-8874-f430196c59fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1286 microversion: 2.20 time: 0.134654 Jul 26 15:35:36.775216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 20/34] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:36 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:37.104654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:37.135665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c49f11a6-aef5-4996-8152-aa33373cd276 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1286 microversion: 2.1 time: 1.348135 Jul 26 15:35:37.153796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 15/35] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:35 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1286 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:37.320157 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:37.321502 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:37.329804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:37.332065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:37.333508 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:37.334219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:37.429537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:37.441875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-df78f7f9-0bbf-4e67-b92b-ba1afe804c2d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1213 microversion: 2.1 time: 0.125720 Jul 26 15:35:37.442973 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 21/36] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:37 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:37.534948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-205725567", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44aad34-88bd-4a3d-a4b4-00a0a6488a28"}], "security_groups": [{"name": "tempest-securitygroup--1477583954"}], "key_name": "tempest-keypair-617595212", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:37.800767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:37.801802 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:37.813515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:37.815838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:37.822153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:37.823994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:37.995011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:38.020108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:38.022377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:38.023545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-84f7241b-0852-4f30-bac2-f7b7eee09421 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1290 microversion: 2.20 time: 0.228831 Jul 26 15:35:38.026936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 22/37] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:37 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1290 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:38.139812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] validate_networks() for [('c44aad34-88bd-4a3d-a4b4-00a0a6488a28', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:38.162792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:38.163854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:38.178317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:38.181467 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:38.182880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:38.199423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:38.433507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:38.445855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0be90edf-59cb-4bb8-aae4-6e29255296c4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1284 microversion: 2.1 time: 0.288114 Jul 26 15:35:38.461908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 23/38] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:38 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:38.481822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:38.484133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:38.539261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:38.540018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:38.541038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:38.544324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:38.780567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:38.803834 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0f94a4df-ddba-4696-8c2c-3dc3dd9c24ab tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1277 microversion: 2.1 time: 0.336748 Jul 26 15:35:38.822713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 24/39] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:38 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1277 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:39.049194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:39.051052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:39.074584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:39.075816 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:39.077704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:39.086678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:39.372770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:39.386295 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:39.387795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:39.395207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-72857d8a-ac56-4cff-84ff-88db74d0948a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1338 microversion: 2.20 time: 0.351721 Jul 26 15:35:39.399527 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 25/40] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:39 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1338 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:39.423147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-390928962", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e973f3b-c20c-47c1-ae4e-46f7a0f09a18"}], "security_groups": [{"name": "tempest-securitygroup--1995228310"}], "key_name": "tempest-keypair-152246200", "user_data": "}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:39.902950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] validate_networks() for [('8e973f3b-c20c-47c1-ae4e-46f7a0f09a18', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:35:40.383472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:40.385052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:40.394159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:40.394159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:40.394159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:40.441825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:40.470043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:40.476894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:40.480274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:40.613154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:40.627297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:40.662606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:40.668178 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:40.946976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-03d9688e-2d35-4acb-8201-57a3b26fa649 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.417591 Jul 26 15:35:40.954994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 16/41] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:35:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 3426 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:35:40.960408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:40.961227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:40.988294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:40.988995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:40.989961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:40.991649 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.312133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:35:41.313163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:35:41.313640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:35:41.314051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:35:41.314460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:35:41.354593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.354593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.354593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.354593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.433508 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for project f81499626e98449897622291738f07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:35:41.456133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for user c2e3c15511fe433a9278248c528c86e0 and project f81499626e98449897622291738f07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:35:41.490350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:35:41.490350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:35:41.526736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:41.674988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1edbc01d-4ee5-4bdb-a1ce-d21a0cba0492 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.274007 Jul 26 15:35:41.683449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 26/42] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:35:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:35:41.704254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:41.708443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:41.726440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:41.746019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e36b575a-ae0b-4be2-9615-6d5629f09e94 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1284 microversion: 2.1 time: 0.789824 Jul 26 15:35:41.753568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.758615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.759454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.759901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.765036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 17/43] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:40 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1284 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:41.789123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:41.789804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:41.809520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.810028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:41.812343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:41.815448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:42.353537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.363202 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6aea9400-4670-4735-8cb5-02fb505ef0c5 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1275 microversion: 2.1 time: 0.678223 Jul 26 15:35:42.386710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 27/44] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:41 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1275 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:42.398783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.402249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-154d6697-7367-4f14-ad93-8efc5817f014 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:42.406952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.411787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-154d6697-7367-4f14-ad93-8efc5817f014 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:42.413895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.418093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b9da3b51-b730-4820-a553-26f500f143e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1344 microversion: 2.20 time: 0.648904 Jul 26 15:35:42.418093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 18/45] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:41 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1344 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:42.428048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-317a31c7-4da7-43be-bc3d-95a29b0ebc3f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:42.438105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-317a31c7-4da7-43be-bc3d-95a29b0ebc3f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:42.551211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-154d6697-7367-4f14-ad93-8efc5817f014 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.558348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-154d6697-7367-4f14-ad93-8efc5817f014 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1244 microversion: 2.1 time: 0.179283 Jul 26 15:35:42.560729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 28/46] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:42 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:42.697907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-317a31c7-4da7-43be-bc3d-95a29b0ebc3f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.715783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-317a31c7-4da7-43be-bc3d-95a29b0ebc3f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1240 microversion: 2.1 time: 0.297078 Jul 26 15:35:42.719206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 19/47] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:42 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1240 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:42.773780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:42.774782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:42.795493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:42.811334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:42.811334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:42.811334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:42.944585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:42.963187 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eda72a3a-f422-4e5d-997a-7188776c7530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1284 microversion: 2.1 time: 0.194577 Jul 26 15:35:42.988869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 29/48] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:42 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:43.397041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:43.397670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:43.416775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.421654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:43.421654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.421654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:43.447425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:43.448832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:43.469910 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.470373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:43.471192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.485167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:43.758533 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:43.792578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:43.794331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:43.796075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b0d64afb-ed49-45ca-8ba2-694bd3a10583 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1344 microversion: 2.20 time: 0.353187 Jul 26 15:35:43.801532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 30/49] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:43 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1344 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:43.833891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:43.834900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:43.851824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.852887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:43.854219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:43.856646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.414850 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:44.436688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-556bbdc7-cb60-4393-91a3-8831e9a7bc93 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1248 microversion: 2.1 time: 0.617196 Jul 26 15:35:44.436688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 31/50] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:43 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1248 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:44.452881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:44.453788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:44.472836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.472836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.472836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.472836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.626660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:44.644722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-01a2c0e9-b210-4d72-bd0b-1f25fb811ef5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1244 microversion: 2.1 time: 0.218949 Jul 26 15:35:44.645897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 32/51] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:44 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1244 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:44.657697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:44.658574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:44.678997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:44.686201 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.686896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.688318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.689127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.691557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-67978dab-b55d-415e-b056-b4f0cd810136 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 1.300133 Jul 26 15:35:44.707470 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 20/52] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:43 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:44.832173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:44.833083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:44.845418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.847634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:44.848704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:44.849306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:45.078812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:45.099161 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5059aa66-e6d1-40c2-af68-ac7c14cadd9d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.444610 Jul 26 15:35:45.099839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 33/53] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:44 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:45.459125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:45.461400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:45.484579 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:45.497389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:45.500047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:45.500971 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:45.808227 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:45.838144 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bc15b44a-2227-47a1-979d-f448eb0c898c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1296 microversion: 2.1 time: 0.383787 Jul 26 15:35:45.839311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 34/54] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:45 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1296 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:45.860967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:45.862086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:45.878644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:45.890380 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:45.910416 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:45.911900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:46.121909 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:46.149195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:46.150731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:46.152597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-72cb0e3a-28f6-44b3-ab78-d5568fb678e5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 1.324336 Jul 26 15:35:46.161278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 21/55] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:44 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:46.167817 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:46.169159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:46.171988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=12 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:46.172401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:46.198873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:46.202279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:46.209096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:46.209096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:46.276551 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bc6e631c-f2d7-453d-9ef7-f3482ad90be4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1292 microversion: 2.1 time: 0.433609 Jul 26 15:35:46.281366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 35/56] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:45 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1292 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:46.308037 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:46.312128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:46.332253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:46.333664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:46.339662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:46.341737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:47.387327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:47.395000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d9554026-dd7c-4a5c-a017-2faa69e33ce8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 1.232250 Jul 26 15:35:47.402982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 22/57] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:46 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:47.421056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:47.421056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:47.432113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:47.432605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:47.433387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:47.433852 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:47.810497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:47.818776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f535516-163c-4943-b0d8-7ed580c276c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1302 microversion: 2.1 time: 0.414616 Jul 26 15:35:47.823092 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 23/58] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:47 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1302 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:47.833048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:47.840216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:47.850084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:47.852317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c4cac528-2dc1-42a3-9cf2-754dccafbcd9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 1.567815 Jul 26 15:35:47.855500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 36/59] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:46 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:47.871602 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:47.872321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:47.877868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:47.878809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.253401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-5c35b51e-dd48-41bb-8ae6-606c9e845dbd req-f8bec80b-2bb2-4efd-a57d-e457fb592264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31cff2e3-818a-4ae8-8593-48a9ee36df41", "tag": "061e4f39-0a38-4fd6-be32-3578a95899ef"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:48.323249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5c35b51e-dd48-41bb-8ae6-606c9e845dbd req-f8bec80b-2bb2-4efd-a57d-e457fb592264 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.324390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5c35b51e-dd48-41bb-8ae6-606c9e845dbd req-f8bec80b-2bb2-4efd-a57d-e457fb592264 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.405511 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-5c35b51e-dd48-41bb-8ae6-606c9e845dbd req-f8bec80b-2bb2-4efd-a57d-e457fb592264 service nova] Creating event network-changed:061e4f39-0a38-4fd6-be32-3578a95899ef for instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 on hv-cinder-85103 Jul 26 15:35:48.408627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5c35b51e-dd48-41bb-8ae6-606c9e845dbd req-f8bec80b-2bb2-4efd-a57d-e457fb592264 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124842) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 15:35:48.416960 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.417742 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.424729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.425606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.468153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.compute.rpcapi [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 15:35:48.474541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] Releasing lock "compute-rpcapi-router" {{(pid=124842) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 15:35:48.506340 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-81f3528e-2858-44c9-9ab9-6a1677cc6e79 None None] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.648767 Jul 26 15:35:48.507223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 37/60] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:48.512732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:48.513836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:48.526876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.528515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.530177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.532905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.538644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:48.668261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:48.677563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c8a42ad6-7f74-417b-8feb-1c38b4ecf09b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1298 microversion: 2.1 time: 0.168886 Jul 26 15:35:48.694127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 38/61] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:48 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:48.703238 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:48.704210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:48.713676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.713676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.713676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:48.713676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:48.803079 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:48.812052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:48.826722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:48.834072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d7f677bb-daee-4445-b85a-a9ebd320f81b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 1.004013 Jul 26 15:35:48.834072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 24/62] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:47 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:48.985456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-0cda7de2-7bf3-427b-b5d7-c1b78cb578cb req-c73b6aff-2127-4f46-b642-7ab402e9f9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f12547e-bcd6-45c7-afee-0e20f7929840", "tag": "c03b7ef2-921a-46c7-a2cf-56b5e31aee6f"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:49.015485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0cda7de2-7bf3-427b-b5d7-c1b78cb578cb req-c73b6aff-2127-4f46-b642-7ab402e9f9bb service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.016037 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0cda7de2-7bf3-427b-b5d7-c1b78cb578cb req-c73b6aff-2127-4f46-b642-7ab402e9f9bb service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.081606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-0cda7de2-7bf3-427b-b5d7-c1b78cb578cb req-c73b6aff-2127-4f46-b642-7ab402e9f9bb service nova] Creating event network-changed:c03b7ef2-921a-46c7-a2cf-56b5e31aee6f for instance 0f12547e-bcd6-45c7-afee-0e20f7929840 on hv-cinder-85103 Jul 26 15:35:49.084155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0cda7de2-7bf3-427b-b5d7-c1b78cb578cb req-c73b6aff-2127-4f46-b642-7ab402e9f9bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 15:35:49.088728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.090577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.093666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.094931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.124485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.compute.rpcapi [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 15:35:49.142448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=124843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 15:35:49.185071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fb5712cb-3f2e-47ea-9c01-5b0c2b5944a1 None None] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354354 Jul 26 15:35:49.186594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 25/63] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:49.203163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:49.205546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:49.227955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.228421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.231711 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.232880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.249281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:49.274103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5956b8f7-8f39-41eb-b8d3-f2dc115469b9 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.578590 Jul 26 15:35:49.288584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 39/64] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:48 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:49.288584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:49.292837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:49.322403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.328219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:49.328219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:49.328219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.265736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:50.296690 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-91eaa80c-efd9-40aa-8467-7e8b1b1af5bd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 1.011029 Jul 26 15:35:50.297640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 40/65] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:49 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:50.312454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:50.313794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:50.322659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.323638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.324212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.324819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.500907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:50.519966 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-35251915-4551-4ebe-98c1-d054cfdb1b04 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1298 microversion: 2.1 time: 0.218885 Jul 26 15:35:50.524450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 41/66] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:50 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1298 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:50.541866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:50.542516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:50.560629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.561289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.562255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.563947 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.712860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:50.723960 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-64ff5189-25dd-43c1-882c-845f8520a37c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 1.535692 Jul 26 15:35:50.724828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 26/67] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:49 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:50.732806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:50.734449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:50.743938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.745004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:50.746069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:50.746652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.026211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:51.037692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f7881ed2-b52b-4ae3-bed3-8cf88b5207d6 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.311237 Jul 26 15:35:51.038655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 27/68] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:50 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:51.240752 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094531b2-332c-4227-9a35-69a4b7cec6ce", "tag": "a7399383-25ce-46f7-8438-c79ed3f59c27"}, {"name": "network-changed", "server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:51.304835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:51.306354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.306901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.318747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:51.321197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:51.336879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-654a9e55-f2a0-4031-a073-c23a9ea53ee1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.802086 Jul 26 15:35:51.345660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 42/69] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:50 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:51.346452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:51.347119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:51.359730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] Creating event network-changed:a7399383-25ce-46f7-8438-c79ed3f59c27 for instance 094531b2-332c-4227-9a35-69a4b7cec6ce on hv-cinder-85103 Jul 26 15:35:51.360373 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] Creating event network-changed:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:35:51.368596 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.368914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.369697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.370129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.372830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-f59c205f-c2ad-4c1e-8c67-88303c00a1f9 req-7f755708-292b-4a36-863f-1da22ea0858c service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.143467 Jul 26 15:35:51.376587 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 28/70] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:51.550168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:51.551562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:51.560314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.561297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.562511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.563775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.782583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:51.797599 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-75ff53d6-77c7-4e90-8252-826c6d2ae327 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.454310 Jul 26 15:35:51.799310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 43/71] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:51 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:51.811303 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:51.814386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:51.822608 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.823341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:51.826941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:51.826941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.144485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.152866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-37308349-e38d-4611-8079-aab96386f270 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.609966 Jul 26 15:35:52.153274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 29/72] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:51 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:52.160226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:52.160962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:52.167804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.168252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.169048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.170280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.296830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.308896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-104810a2-5db7-4d91-aa07-547a64003c32 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.507965 Jul 26 15:35:52.323075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 44/73] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:51 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:52.325346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.340861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a4be3f72-97cb-474e-b0cc-98bc8b3f9e76 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.185771 Jul 26 15:35:52.343767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 30/74] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:52 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:52.356430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:52.358604 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:52.365319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.366353 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.367161 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.367603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.558924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=36 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:52.813209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.824031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:52.824689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:52.828618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=28 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:52.829377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.831118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:52.835049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.835201 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-be21111a-cce7-499d-9b53-a1a23d2adba0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.482622 Jul 26 15:35:52.835296 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:52.835388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 45/75] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:52 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:52.847603 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:52.848240 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.041041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:53.062716 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6277ceb8-eaa8-4258-8d98-b213181c8417 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.244840 Jul 26 15:35:53.063306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 31/76] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:52 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:53.175255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:53.175880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:53.182538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.182997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.183780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.184214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.348997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:53.348997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:53.351627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.352703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.354275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.355250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.588943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:53.599245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4f1e4fc6-10fc-41a1-ba6f-4f83efe82e9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.271104 Jul 26 15:35:53.600342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 32/77] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:53 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:53.617860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:53.619050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:53.619450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:53.629231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.629784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.630707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.631345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.635353 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ce5939a8-aa26-403b-bf38-b57023360f34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.465802 Jul 26 15:35:53.636139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:53.638779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 46/78] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:53 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:53.679051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-289eb4b4-568b-4230-8508-03bb3cc43173 req-7601a318-24e9-490e-9bfc-4d982a54f994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a", "tag": "096e1cf8-00e9-43b3-ab30-7af29a5b4795"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:53.692318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-289eb4b4-568b-4230-8508-03bb3cc43173 req-7601a318-24e9-490e-9bfc-4d982a54f994 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.693287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-289eb4b4-568b-4230-8508-03bb3cc43173 req-7601a318-24e9-490e-9bfc-4d982a54f994 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.708042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-289eb4b4-568b-4230-8508-03bb3cc43173 req-7601a318-24e9-490e-9bfc-4d982a54f994 service nova] Creating event network-changed:096e1cf8-00e9-43b3-ab30-7af29a5b4795 for instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a on hv-cinder-85103 Jul 26 15:35:53.715683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-289eb4b4-568b-4230-8508-03bb3cc43173 req-7601a318-24e9-490e-9bfc-4d982a54f994 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074843 Jul 26 15:35:53.716951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 47/79] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:53.863318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:53.872138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:53.883024 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.883507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.885404 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:53.885838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:53.894061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:53.904943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6d6126b9-9c8a-43df-b96c-addd400428dc tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.297830 Jul 26 15:35:53.906740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 33/80] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:53 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:54.056333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:54.065986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:54.067478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:54.068636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2d7b7f3e-d1a9-4a75-8411-bbd56dc97d17 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.212379 Jul 26 15:35:54.069346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 48/81] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:53 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:54.086988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:54.087629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:54.095310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.095772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:54.096686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.097173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:54.237799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:54.245290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-51bc063e-c1a6-45b4-b6d9-f71c8d937079 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.162699 Jul 26 15:35:54.245863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 34/82] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:54 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:54.629976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:54.630592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:54.637087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.637565 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:54.639204 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.639649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:54.665073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:54.665952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:54.673868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.674434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:54.675416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:54.675863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.205854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.218790 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-69f27f01-d127-4257-aab0-3cd96c50ac1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.557446 Jul 26 15:35:55.232328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 35/83] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:54 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:55.232328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:55.234408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:55.243848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.244298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.255627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.256399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.256693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.304745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c74708da-02d1-4ef3-ae05-af4df98b2144 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.675913 Jul 26 15:35:55.305632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 49/84] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:54 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:55.333118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:55.334279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:55.346430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.347061 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.348730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.349785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.632628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.648409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7e359f19-939a-45c8-8827-a7746c3d945b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.426643 Jul 26 15:35:55.649592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 36/85] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:55 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:55.666246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:55.666986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:55.675407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.675867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.676696 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.677356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.727497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.739729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.742628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.744354 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-23fc686b-07d8-4198-9d7d-321b42d6b3db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.437254 Jul 26 15:35:55.745640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 50/86] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:55 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:35:55.754767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-82343083-3818-49c0-bdf8-70113c98fde0 req-dddf7f47-588c-487e-8338-0af28709fa40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f25fe8-dfd0-4c65-bb2d-a5dd15567b85", "tag": "c2d8a054-3dab-4928-969a-c1b58ea17b2a"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:35:55.770781 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-82343083-3818-49c0-bdf8-70113c98fde0 req-dddf7f47-588c-487e-8338-0af28709fa40 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:55.771321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-82343083-3818-49c0-bdf8-70113c98fde0 req-dddf7f47-588c-487e-8338-0af28709fa40 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:55.785089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-82343083-3818-49c0-bdf8-70113c98fde0 req-dddf7f47-588c-487e-8338-0af28709fa40 service nova] Creating event network-changed:c2d8a054-3dab-4928-969a-c1b58ea17b2a for instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 on hv-cinder-85103 Jul 26 15:35:55.791004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-82343083-3818-49c0-bdf8-70113c98fde0 req-dddf7f47-588c-487e-8338-0af28709fa40 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043626 Jul 26 15:35:55.791616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 51/87] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:35:55.853907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:55.863243 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3699f398-b8e5-4359-862e-f2bde85511fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.212578 Jul 26 15:35:55.863917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 37/88] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:55 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:56.240154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:56.240739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:56.247104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.247526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.248414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.248877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.332864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:56.333486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:56.339883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.340334 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.341911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.342432 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.449125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:56.462665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7bfd53a8-3955-4261-95be-7c6f513f3b89 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.226778 Jul 26 15:35:56.463762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 52/89] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:56 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:56.493061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:56.503854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fb5341ee-6342-4ae9-863e-7e34aaa9ac1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.174789 Jul 26 15:35:56.511489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 38/90] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:56 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:56.674443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:56.675054 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:56.681031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.681478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.682239 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.682710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.777306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:56.778017 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:56.786588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.787052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.787839 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.788280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.839140 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:56.847844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2acd6b85-becd-4962-b79c-c956023b5e57 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.177163 Jul 26 15:35:56.848439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 53/91] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:56 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:56.885854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:56.886488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:56.898077 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.898564 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:56.899346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:56.899759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.051219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.064427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-86628072-da20-4295-a870-56ef472e4d5d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.181827 Jul 26 15:35:57.066346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 54/92] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:56 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:57.138751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.146741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.151710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.151710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e1e7107f-d115-44b2-bd8a-685bd5c94c55 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.376948 Jul 26 15:35:57.151710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 39/93] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:56 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:57.484442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:57.485082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:57.492644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.493706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.494723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.495149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.526943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:57.527914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:57.535168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.535615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.537144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.537789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.651509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.661164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-af1945fb-3d8e-4144-9aac-efadc22d798a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.181162 Jul 26 15:35:57.673316 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 55/94] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:57 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:57.765491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:57.775194 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5b4f93b2-5bfd-44a2-ac3f-60ac73e1fd96 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.252378 Jul 26 15:35:57.792365 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 40/95] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:57 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:57.869795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:57.870463 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:57.877341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.877783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.878545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:57.879075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:57.883289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:58.078940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.089894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:58.092620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:58.096670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-99128939-9235-4231-9b01-e43edd08d2af tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.230194 Jul 26 15:35:58.099447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 56/96] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:57 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:58.112656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.113121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.114170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.114612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.175287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:58.176154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:58.191189 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.191642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.200969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.201861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.350589 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.362131 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-46e9f29f-157b-4a3b-a8b7-a62eb1078965 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.276512 Jul 26 15:35:58.362960 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 41/97] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:58 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:58.437130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.445806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.449185 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.452054 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-70ecbf84-aefc-4072-a36a-596e9fde8c6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.281571 Jul 26 15:35:58.457829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 57/98] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:58 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:58.683615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:58.684314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:58.694046 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.694046 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.694204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.694650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.797555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:58.798251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:58.800335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=6 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:58.805441 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.805887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.806691 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:58.807122 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:58.837077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.844927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a7bed9d0-7449-436b-aa29-b903401774e3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.165663 Jul 26 15:35:58.862322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 42/99] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:58 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:58.955116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:58.963034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d8bf81ed-b9b2-4e53-8bf7-540d182c9242 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.169964 Jul 26 15:35:58.963654 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 58/100] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:58 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:35:59.118977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:59.119639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:59.123556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=10 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:59.127177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.127622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.128406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.130800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.294803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:59.308610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bfeddd3f-0f92-4781-acee-994d5251b91a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.193249 Jul 26 15:35:59.309217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 43/101] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:59 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:59.387188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:59.388421 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:59.398825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.399283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.407582 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.407582 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.476571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:59.477048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:59.484666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.485131 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.485922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.486352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.647484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:59.663104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1f90d612-d931-4a26-b707-e31057fc3611 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.278682 Jul 26 15:35:59.668722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 59/102] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:59 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:35:59.724328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:59.742559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:59.745086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:35:59.747506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-95f76f25-ad9e-4971-96f8-f184a12fc669 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.274442 Jul 26 15:35:59.748733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 44/103] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:35:59 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:35:59.873602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:59.873602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:59.874142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.874664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.875535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:35:59.875979 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:35:59.987767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:35:59.989068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:35:59.996701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.000822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.000822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.000822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.214315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.239460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cab64d96-46e3-4d8a-b606-647f43950e25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.256063 Jul 26 15:36:00.240055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 45/104] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:59 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:00.331228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.333806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:00.338620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:00.354717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.355264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-32def73c-1276-4c84-805b-363dbae6706d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.490110 Jul 26 15:36:00.356173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 60/105] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:35:59 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:00.357850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.358947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.359531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.674019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.678560 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ac7bc69a-7825-417e-a46d-efa70bd7c846 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.350976 Jul 26 15:36:00.679141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 46/106] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:00 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:00.689972 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:00.690827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:00.707715 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.708528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.711042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.711797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.771480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:00.772094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:00.778429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.778948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.779733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:00.780174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:00.852887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.862670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a4960bd3-8946-479c-87d2-737657cc6ed5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.176894 Jul 26 15:36:00.866049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 61/107] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:00 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:00.941044 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.951792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.953419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:00.954825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-727c7f9c-c37d-4b67-910c-f7505c994c04 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.187292 Jul 26 15:36:00.955707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 47/108] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:00 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:36:01.262351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:01.264344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.270728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.271176 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.272010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.272437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.401737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:01.401737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.401737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.401737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.402484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.402484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.529206 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:01.560895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8d4c94e6-786c-42a8-9936-67b2fdfbb585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.293572 Jul 26 15:36:01.560895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 62/109] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:01 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:01.710111 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:01.714919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.724540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.725640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.727088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.728108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.750475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:01.760835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4feae9b4-f806-4e73-9e86-379bd3f18325 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.385143 Jul 26 15:36:01.762117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 48/110] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:01 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:01.875844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-8932f056-0111-422b-b591-05cf28d009b0 req-2ccee0fe-dff6-412b-9965-5e7fb8725e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cff2e3-818a-4ae8-8593-48a9ee36df41", "name": "network-vif-plugged", "status": "completed", "tag": "061e4f39-0a38-4fd6-be32-3578a95899ef"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:01.875844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8932f056-0111-422b-b591-05cf28d009b0 req-2ccee0fe-dff6-412b-9965-5e7fb8725e3d service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.875844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8932f056-0111-422b-b591-05cf28d009b0 req-2ccee0fe-dff6-412b-9965-5e7fb8725e3d service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.878858 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-8932f056-0111-422b-b591-05cf28d009b0 req-2ccee0fe-dff6-412b-9965-5e7fb8725e3d service nova] Creating event network-vif-plugged:061e4f39-0a38-4fd6-be32-3578a95899ef for instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 on hv-cinder-85103 Jul 26 15:36:01.886063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-8932f056-0111-422b-b591-05cf28d009b0 req-2ccee0fe-dff6-412b-9965-5e7fb8725e3d service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102439 Jul 26 15:36:01.887239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 49/111] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:01.893322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:01.894454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.902948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.903448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.904767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.905226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.933885 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:02.054443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.063060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b8bf0d56-4bbd-43fa-b72a-cf4c9280e0a2 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.363380 Jul 26 15:36:02.063649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 63/112] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:01 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:02.068177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:02.068806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:02.075322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.075778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.076581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.077173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.105124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.115740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e8a68a51-1add-4cbe-b33c-e9f7c08a2376 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.225946 Jul 26 15:36:02.127976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 50/113] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:01 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:02.291536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.301332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.303714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.304933 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-06cc1e05-67e0-4c28-b48c-26d1ea6372db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.240349 Jul 26 15:36:02.305530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 64/114] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:02 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:02.580532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:02.581155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:02.587865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.588325 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.589239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.589650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.781647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.787938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:02.789486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:02.789850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-79f5d65a-104f-4d58-8b7f-5230be99a0e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.214157 Jul 26 15:36:02.790911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 51/115] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:02 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:02.802852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.813962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.813962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.813962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.961431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.970532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a66043f5-721d-4fed-83b1-0341b113b805 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.187813 Jul 26 15:36:02.971847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 65/116] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:02 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:03.084608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:03.085152 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:03.092089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.097337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.097337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.097337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.147205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:03.147827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:03.155125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.155577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.156350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.156833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.335082 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:03.345807 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9c331ecc-28dd-4739-a07a-21337f6e90ba tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.265046 Jul 26 15:36:03.356552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 52/117] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:03 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:03.359654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:03.360616 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:03.368156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.368966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.370141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.370583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.520728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:03.533081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b8dd6515-d967-48a1-9eea-f16e60946b1f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.389616 Jul 26 15:36:03.551720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 66/118] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:03 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:03.572190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:03.582983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:03.585408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:03.586774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6ab29f0e-551f-4c7d-9986-ce70b4765dfd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.232694 Jul 26 15:36:03.587593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 53/119] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:03 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:03.812925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:03.813552 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:03.819954 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.820671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.821615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.822282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.906699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f12547e-bcd6-45c7-afee-0e20f7929840", "name": "network-vif-plugged", "status": "completed", "tag": "c03b7ef2-921a-46c7-a2cf-56b5e31aee6f"}, {"server_uuid": "094531b2-332c-4227-9a35-69a4b7cec6ce", "name": "network-vif-plugged", "status": "completed", "tag": "a7399383-25ce-46f7-8438-c79ed3f59c27"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:03.925181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:03.925609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:03.954818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] Creating event network-vif-plugged:c03b7ef2-921a-46c7-a2cf-56b5e31aee6f for instance 0f12547e-bcd6-45c7-afee-0e20f7929840 on hv-cinder-85103 Jul 26 15:36:03.958660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] Creating event network-vif-plugged:a7399383-25ce-46f7-8438-c79ed3f59c27 for instance 094531b2-332c-4227-9a35-69a4b7cec6ce on hv-cinder-85103 Jul 26 15:36:03.970714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-46cb0c45-cb0a-4bf2-8c4c-40ec6512de4e req-cd058db1-7448-4296-af9e-c6c92ca77bb8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068819 Jul 26 15:36:03.971684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 54/120] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:03.998088 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:03.999492 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:04.011408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.012994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.015003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.015609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.193362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.204419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eb3e1228-65fd-47fc-af11-fcf635fb733f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.396156 Jul 26 15:36:04.207003 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 67/121] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:03 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:04.234350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.253802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-333677e2-903c-48c8-9c73-31497779d333 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.264022 Jul 26 15:36:04.254938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 55/122] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:03 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:04.369081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:04.370652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:04.378085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.378828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.386195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.386195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.560861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:04.560861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:04.569507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.570067 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.570955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.571409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.619769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.629058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ff5351df-27c8-4a43-86f0-5ba9bc7f0d6b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.265654 Jul 26 15:36:04.629805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 68/123] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:04 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:04.634423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:04.635038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:04.646267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.646716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.647503 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.647965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.737743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.747187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2414c876-c133-484c-ba0b-03d1378f39aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.192143 Jul 26 15:36:04.747853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 56/124] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:04 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:04.818338 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.827763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.829419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.835887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8821e093-32de-43b9-8273-39e2f6a5a308 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.199797 Jul 26 15:36:04.835887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 69/125] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:04 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:05.232354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.233276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.239324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.239775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.240739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.241326 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.278648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.279362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.286079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.286524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.287285 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.287714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.394955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:05.404943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-386d15f6-99db-478d-8f45-ea6797afac0d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.174516 Jul 26 15:36:05.404943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 57/126] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:05.443371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:05.452337 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6b64431c-6803-4058-8d39-df04b990126f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.177906 Jul 26 15:36:05.458385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 70/127] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:05.651607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.652353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.658656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.659250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.660233 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.660819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.769976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.770736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.781865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.784350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.785479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.785927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.808234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:05.821624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f6c4465b-18c6-4af9-a9c2-f7e36361b948 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1317 microversion: 2.1 time: 0.173830 Jul 26 15:36:05.822281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 58/128] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:05.858422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.869103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.877259 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.877710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.878503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.878947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.975655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:05.992396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-18c83822-cd30-446f-88ef-21402c69da45 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.227729 Jul 26 15:36:05.994383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 71/129] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:06.093988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.102443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.103996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.105329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c2e3e8f3-9efb-46ab-acc4-9f3652478fc5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.252048 Jul 26 15:36:06.106607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 59/130] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:06.426139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:06.426760 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:06.433081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.433837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.434964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.435583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.482889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:06.483708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:06.492396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.492830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.493779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.494248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.654100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.657944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.658449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:06.665392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1a727022-e119-44fa-8951-588bc253a5ef tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.243431 Jul 26 15:36:06.665985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 72/131] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:06 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:06.666481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-419b3655-cd48-41cf-ac6a-cc0382ac2e49 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.189531 Jul 26 15:36:06.680566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 60/132] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:06 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:06.848168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:06.849253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:06.856355 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.857065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.858329 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.858765 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.860575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-d85c1d52-44dc-4ae9-8a1a-ec1570ea6d3d req-6174b682-a9f4-41fa-bbb1-abff3a771c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "name": "network-vif-plugged", "status": "completed", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:06.879626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d85c1d52-44dc-4ae9-8a1a-ec1570ea6d3d req-6174b682-a9f4-41fa-bbb1-abff3a771c1e service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.880087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d85c1d52-44dc-4ae9-8a1a-ec1570ea6d3d req-6174b682-a9f4-41fa-bbb1-abff3a771c1e service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.897616 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-d85c1d52-44dc-4ae9-8a1a-ec1570ea6d3d req-6174b682-a9f4-41fa-bbb1-abff3a771c1e service nova] Creating event network-vif-plugged:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:36:06.904554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-d85c1d52-44dc-4ae9-8a1a-ec1570ea6d3d req-6174b682-a9f4-41fa-bbb1-abff3a771c1e service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046730 Jul 26 15:36:06.906641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 61/133] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:07.018199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:07.018975 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:07.026901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.027460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.028878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.029378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.061323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.075475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-948ae47c-c768-43ec-ac2b-85b56297b3ae tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1504 microversion: 2.1 time: 0.235243 Jul 26 15:36:07.077223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 73/134] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:06 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:07.147627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:07.149025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:07.153974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:07.162809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.163545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.164968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.165479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.281809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.293952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-85a84a76-6aaf-4e4f-8d89-8d1d851c7861 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1326 microversion: 2.1 time: 0.280573 Jul 26 15:36:07.307223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 62/135] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:07 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1326 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:07.387938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.401839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.404080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.407886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0e687fc2-ef07-4f4b-919e-dc2670bcb9e0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.264874 Jul 26 15:36:07.407886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 74/136] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:07 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:07.703428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:07.704057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:07.705945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:07.706588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:07.731367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.732038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.732579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.732923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.733301 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.733745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.734228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.734228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.969024 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.977415 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a35508d4-8685-4ad9-ad0c-6e57786271e9 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.290512 Jul 26 15:36:07.978736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.990489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 75/137] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:07 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:07.993321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a4e89615-5db6-4777-bed9-845104cbebcc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.305499 Jul 26 15:36:08.000221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 63/138] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:07 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:08.315021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:08.316386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:08.324016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.325083 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.326185 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.326739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.441551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:08.442650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:08.454489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.454988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.457711 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.458385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.519224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:08.540591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-40d83984-7643-4557-9116-e7a454f269b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1520 microversion: 2.1 time: 0.229658 Jul 26 15:36:08.544668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 76/139] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:08 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:08.566876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:08.569761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:08.577974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.578481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.579440 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.579877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.648854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'flavor' on Instance uuid 094531b2-332c-4227-9a35-69a4b7cec6ce {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:36:08.673128 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:08.681843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:08.683638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:08.685853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-619254ed-437c-4a55-adaf-53b2943e7b2f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.258016 Jul 26 15:36:08.686612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 64/140] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:08 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:08.923275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f25fe8-dfd0-4c65-bb2d-a5dd15567b85", "name": "network-vif-plugged", "status": "completed", "tag": "c2d8a054-3dab-4928-969a-c1b58ea17b2a"}, {"server_uuid": "5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a", "name": "network-vif-plugged", "status": "completed", "tag": "096e1cf8-00e9-43b3-ab30-7af29a5b4795"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:08.937241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.938130 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.971646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] Creating event network-vif-plugged:c2d8a054-3dab-4928-969a-c1b58ea17b2a for instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 on hv-cinder-85103 Jul 26 15:36:08.972155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] Creating event network-vif-plugged:096e1cf8-00e9-43b3-ab30-7af29a5b4795 for instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a on hv-cinder-85103 Jul 26 15:36:08.979093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-ac37b5d9-daa7-464d-b3c4-0fe4e8118d15 req-1e3716f1-8254-40dd-8ab9-55a3e76df723 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059430 Jul 26 15:36:08.980038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 65/141] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:09.020199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:09.021029 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.030350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.031171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.031866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.032450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.040078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2dfb2317-dff0-4bf6-9306-80d58dfc5583 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce/action" status: 200 len: 32 microversion: 2.1 time: 0.477584 Jul 26 15:36:09.040725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 77/142] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:36:08 2022] POST /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce/action => generated 32 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:36:09.049370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:09.050411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.057489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.059291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.061431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.063059 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.273444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.281191 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5837aa48-42d5-421a-a1fe-33757f346da8 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.269760 Jul 26 15:36:09.282082 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 66/143] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:09 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:09.297182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.298821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:09.303601 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.305871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1fa87db4-ab9c-4467-bca1-a178bfa9a8fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.263952 Jul 26 15:36:09.311015 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 78/144] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:09 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:09.320352 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eecfe081-5c82-4c15-a591-bee5d79c3a1c"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:09.328977 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.331977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.332679 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.334019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.334971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.348868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.349476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.350350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.350849 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.647140 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.662914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2c05ef29-161d-42ab-90f2-0ba7a8d977f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.379473 Jul 26 15:36:09.663472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 67/145] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:09 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:09.710113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:09.710986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.718837 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.719606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.720593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.721184 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.917451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.929148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.930974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:09.932298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62199b88-985e-422d-8a1c-f39060f8de8c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.227468 Jul 26 15:36:09.933367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 68/146] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:09 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:36:10.302549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:10.303526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:10.311088 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.311716 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.312523 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.312964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.318673 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:10.333733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-386bb594-eee4-4d25-a62d-564cf2ff0fb8 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "POST /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.020738 Jul 26 15:36:10.351267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 79/147] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:36:09 2022] POST /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:10.357324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:10.364500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:10.384113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.384673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.387506 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.388642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.559210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:10.567535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2813ac94-17b7-43dc-953f-bf479991bdc0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.268927 Jul 26 15:36:10.568119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 69/148] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:10 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:10.601812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:10.610436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5ffe1cb9-fde2-4a01-8193-10b7a8c82526 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.262071 Jul 26 15:36:10.611019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 80/149] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:10 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:10.686101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:10.686816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:10.694311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.694764 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.695542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.695977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.841651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:10.849212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bdc8fc49-7477-402a-8ac5-6f3318795d4a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.168097 Jul 26 15:36:10.850168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 70/150] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:10 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:10.956628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:10.957238 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:10.964260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.964895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.965766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:10.966350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.125792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.134243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.135766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.136898 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d22eb382-75d5-406a-8889-4c8f9a80f556 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.184244 Jul 26 15:36:11.137450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 81/151] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:10 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:36:11.588568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:11.589448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:11.595747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.596294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.597036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.597483 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.631637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:11.638009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:11.667017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.667467 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.668416 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.669070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.801621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.812919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-92feea58-ce81-4e16-85bc-8273d49f20f7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.228054 Jul 26 15:36:11.825446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 71/152] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:11 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:11.870189 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:11.870798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:11.873506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:11.880012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.880731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.882714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.882714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.885654 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.893577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d3e0bc38-064a-456c-b3fe-5495ee3a34ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1370 microversion: 2.1 time: 0.265978 Jul 26 15:36:11.894167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 82/153] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:11 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:12.029804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:12.038175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-299c6759-b25e-4686-b6d4-78bd3eaa2056 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.173121 Jul 26 15:36:12.038678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 72/154] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:11 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:12.160365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:12.161015 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:12.168539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.169322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.170467 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.170905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.304332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:12.316943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:12.318153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:12.319322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c326d816-0619-49ad-98c2-e89cc390c88f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1411 microversion: 2.20 time: 0.163411 Jul 26 15:36:12.323472 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 83/155] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:12 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:12.836124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:12.838199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:12.846489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.847357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.848639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.849061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.917071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:12.919844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:12.925053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.925703 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.926643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.927082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.024280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.035288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-125af372-990b-416f-88f6-07762f66a5b2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.202484 Jul 26 15:36:13.035288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 73/156] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:12 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:13.067936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:13.068919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:13.085604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.086595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.087544 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.088168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.088384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.099868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d7912bf0-0774-449e-a204-08c7c90ccfb5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1557 microversion: 2.1 time: 0.188162 Jul 26 15:36:13.100432 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 84/157] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:12 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:13.122324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:13.122961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:13.129855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.130401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.131279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.131990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.237930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-dda786cd-03f1-47d0-bc78-766bfc186620 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120042 Jul 26 15:36:13.238660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 85/158] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:36:13 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:13.269465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.286834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8484ee57-25aa-4319-a55e-120c6342ae2b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.224722 Jul 26 15:36:13.290884 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 74/159] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:13 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:13.343451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:13.344090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:13.350688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.351379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.352158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.352730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.372153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:13.845788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.856515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.860803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.862220 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ea227b3a-4546-45f1-8c78-d5609c8aff4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1603 microversion: 2.20 time: 0.523260 Jul 26 15:36:13.862655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 86/160] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:36:13 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1603 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:36:13.889351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:13.889867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:13.896787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.898064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.899024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.899563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.056056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-869b5ecb-dad7-4981-bb0b-1c3afc0f0f28 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.172879 Jul 26 15:36:14.057042 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 75/161] 10.222.0.128 () {60 vars in 1321 bytes} [Tue Jul 26 15:36:13 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:36:14.064966 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:14.067067 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:14.081899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.082842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.084126 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.085512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.312223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:14.313012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:14.323855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.325375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.326405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.326999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.520400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:14.530137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5c3b53be-9b35-42ff-9e6f-5fb06df43003 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1366 microversion: 2.1 time: 0.475637 Jul 26 15:36:14.530732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 87/162] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:14 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:14.843949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:14.861648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3cfb75c3-1ffa-4c29-9d41-d6f44a6024f1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.554548 Jul 26 15:36:14.862232 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 76/163] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:14 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:15.213561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-bea68454-cda2-416a-9fad-8e5c546411b3 req-926d642d-7292-4d61-b1b1-a548af6405f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a", "tag": "096e1cf8-00e9-43b3-ab30-7af29a5b4795"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:15.225968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bea68454-cda2-416a-9fad-8e5c546411b3 req-926d642d-7292-4d61-b1b1-a548af6405f7 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.226784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bea68454-cda2-416a-9fad-8e5c546411b3 req-926d642d-7292-4d61-b1b1-a548af6405f7 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.242865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-bea68454-cda2-416a-9fad-8e5c546411b3 req-926d642d-7292-4d61-b1b1-a548af6405f7 service nova] Creating event network-changed:096e1cf8-00e9-43b3-ab30-7af29a5b4795 for instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a on hv-cinder-85103 Jul 26 15:36:15.249454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-bea68454-cda2-416a-9fad-8e5c546411b3 req-926d642d-7292-4d61-b1b1-a548af6405f7 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039401 Jul 26 15:36:15.250940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 88/164] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:15.552505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:15.553413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:15.560217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.560799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.561599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.562979 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.802733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:15.812406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ca5dd12f-0fff-4380-9a53-0f518c2dea35 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1552 microversion: 2.1 time: 0.265039 Jul 26 15:36:15.825175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 77/165] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:15 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1552 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:15.839462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:15.841643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:15.857825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.858538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.861011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.861953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.893676 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-3730afc4-12cc-4480-8e65-95aba4552c30 req-1f66496f-7254-465a-bc17-1f6a9e0f16e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:15.919542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3730afc4-12cc-4480-8e65-95aba4552c30 req-1f66496f-7254-465a-bc17-1f6a9e0f16e9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.920199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3730afc4-12cc-4480-8e65-95aba4552c30 req-1f66496f-7254-465a-bc17-1f6a9e0f16e9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.936374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-3730afc4-12cc-4480-8e65-95aba4552c30 req-1f66496f-7254-465a-bc17-1f6a9e0f16e9 service nova] Creating event network-changed:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:36:15.942416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-3730afc4-12cc-4480-8e65-95aba4552c30 req-1f66496f-7254-465a-bc17-1f6a9e0f16e9 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068241 Jul 26 15:36:15.943274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 78/166] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:15.967094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:15.974303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:16.015780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:16.017943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:16.019898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:16.021430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:16.071060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eb065e66-a8be-476d-a0f3-c79c263da9a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236922 Jul 26 15:36:16.071843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 89/167] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:36:15 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:17.000840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:17.019915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fb74f799-b6c8-4f1a-8b09-f2a2f29d1502 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 1.064416 Jul 26 15:36:17.020639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 79/168] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:15 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:18.049655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:18.050420 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:18.059422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.059953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.063609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.064193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.180981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-4f896e10-e9bd-436f-8666-638ea6348e9b req-0e252058-fe81-4d71-9e9c-b640330eb11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f25fe8-dfd0-4c65-bb2d-a5dd15567b85", "tag": "c2d8a054-3dab-4928-969a-c1b58ea17b2a"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:18.216539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4f896e10-e9bd-436f-8666-638ea6348e9b req-0e252058-fe81-4d71-9e9c-b640330eb11a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.216539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4f896e10-e9bd-436f-8666-638ea6348e9b req-0e252058-fe81-4d71-9e9c-b640330eb11a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.251607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-4f896e10-e9bd-436f-8666-638ea6348e9b req-0e252058-fe81-4d71-9e9c-b640330eb11a service nova] Creating event network-changed:c2d8a054-3dab-4928-969a-c1b58ea17b2a for instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 on hv-cinder-85103 Jul 26 15:36:18.266097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-4f896e10-e9bd-436f-8666-638ea6348e9b req-0e252058-fe81-4d71-9e9c-b640330eb11a service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092305 Jul 26 15:36:18.268016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 80/169] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:18.290920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:18.300071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-152876d1-bd21-4ef4-a1e1-fdd11a80e05b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.257876 Jul 26 15:36:18.301489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 90/170] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:18 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:19.322891 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:19.324144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:19.331290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:19.331970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:19.332765 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:19.333196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:19.476178 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:19.485333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e96efe72-c208-48f1-89ef-3a10678a67f4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.167988 Jul 26 15:36:19.485922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 81/171] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:19 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:20.506065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:20.506682 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:20.514306 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:20.514749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:20.515518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:20.515956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:20.646534 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:20.654120 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e12a848b-e8c7-4eba-8df0-39f9cda167f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.152003 Jul 26 15:36:20.654695 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 91/172] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:20 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:21.674650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:21.675679 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:21.682075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:21.682646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:21.683525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:21.683979 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:21.821459 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:21.832148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f0d29c6-7f4f-41fe-a4fe-9b7b7e4daa73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.161228 Jul 26 15:36:21.833195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 82/173] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:21 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:22.854537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:22.855152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:22.861923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:22.862367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:22.863138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:22.863577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:22.994483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:23.002728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8c6899e0-91d2-485a-9bf0-8688f305e4a7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.152232 Jul 26 15:36:23.003349 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 92/174] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:22 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:24.023235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:24.023754 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:24.030816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:24.031257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:24.032018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:24.032448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:24.164084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:24.171655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b4756652-dc25-4e0a-b013-77e3b345287d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.152340 Jul 26 15:36:24.172481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 83/175] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:24 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:25.193923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:25.194531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:25.202221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:25.202662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:25.203425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:25.207419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:25.340285 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:25.348080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-baa66dfd-43cd-4af1-9b79-ddea81ffcfe3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.157888 Jul 26 15:36:25.348736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 93/176] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:25 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:26.369279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:26.370825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:26.377079 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:26.377531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:26.378309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:26.378751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:26.508584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:26.516489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8df47d18-caf4-4a5e-9933-82ec45b704e7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.151022 Jul 26 15:36:26.517063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 84/177] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:26 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:27.538652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:27.539172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:27.546294 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:27.546734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:27.547496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:27.547958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:27.677138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:27.684546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-af400693-5ad2-4845-bac7-9b37d68def73 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.149911 Jul 26 15:36:27.685244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 94/178] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:27 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:28.705959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:28.706464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:28.712530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:28.712980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:28.713793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:28.714204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:28.852431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:28.860783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6c394bfc-1cda-4260-b8c3-21de44260564 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.158760 Jul 26 15:36:28.861355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 85/179] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:28 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:29.882918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:29.883708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:29.890522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:29.890969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:29.891739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:29.892172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:30.037900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:30.046708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-48bd4384-f912-48d7-9d2e-258fd1d354e3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.167884 Jul 26 15:36:30.047284 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 95/180] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:29 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:31.067375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:31.067985 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:31.074508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.075050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.076548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.076994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.225509 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:31.234176 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a07ac94-1df6-4609-bd1f-0482ee328991 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.170709 Jul 26 15:36:31.234946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 86/181] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:31 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:31.432559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:31.433067 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:31.440831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.442640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.442640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.442640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.469245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:36:31.780061 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4b97e947-dfaa-47fa-8377-8bcbe205fa3a tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "DELETE /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 204 len: 0 microversion: 2.1 time: 0.349828 Jul 26 15:36:31.784396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 96/182] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:36:31 2022] DELETE /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:36:31.791636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:31.792400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:31.799584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.800037 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.800865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.801298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.821003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:31.941678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:31.951412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d720782d-ee20-48ff-a628-709919b63d47 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1556 microversion: 2.1 time: 0.163448 Jul 26 15:36:31.958648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 87/183] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:31 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:32.262228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:32.265128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:32.274875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.275327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.276164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.277078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.452680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:32.466906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ad128789-97a6-422a-8a8c-2cdf9a958555 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.210046 Jul 26 15:36:32.468753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 97/184] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:32 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:32.974814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:32.975423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:32.982162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.983045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.983818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.984417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:33.183281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:33.192492 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e5adb00f-e5ca-4ffd-99bb-8c99712dce25 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1556 microversion: 2.1 time: 0.223036 Jul 26 15:36:33.196868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 88/185] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:32 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:33.490255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:33.490974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:33.500815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:33.501430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:33.502251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:33.502967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:33.657661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:33.665763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-985114ee-d066-4f3c-952f-86e91e6f1809 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.179333 Jul 26 15:36:33.666348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 98/186] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:33 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:34.222431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:34.222431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:34.222431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:34.222431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:34.223169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:34.223543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:34.377557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:34.400583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1cab0521-0a34-403a-a8ee-934d38bea46d tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1556 microversion: 2.1 time: 0.177832 Jul 26 15:36:34.400583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 89/187] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:34 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:34.688800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:34.688800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:34.695279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:34.695731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:34.696522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:34.696961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:34.842240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:34.851994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-aad13293-44b9-4332-b494-45dc24c4dc6e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.168778 Jul 26 15:36:34.852764 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 99/188] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:34 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:35.411256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:35.412010 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:35.419158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:35.420225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:35.421360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:35.421941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:35.579930 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:35.593229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62e6bcce-015b-4289-a45f-7b2705d4121e tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1514 microversion: 2.1 time: 0.181066 Jul 26 15:36:35.593229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 90/189] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:35 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:35.600995 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-2399d309-6eee-43fd-8eb7-5c891fac667a req-85a61855-8c88-42e8-8c78-2a31fd32928f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31cff2e3-818a-4ae8-8593-48a9ee36df41", "name": "network-vif-deleted", "tag": "061e4f39-0a38-4fd6-be32-3578a95899ef"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:35.611225 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2399d309-6eee-43fd-8eb7-5c891fac667a req-85a61855-8c88-42e8-8c78-2a31fd32928f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:35.611666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2399d309-6eee-43fd-8eb7-5c891fac667a req-85a61855-8c88-42e8-8c78-2a31fd32928f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:35.626273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-2399d309-6eee-43fd-8eb7-5c891fac667a req-85a61855-8c88-42e8-8c78-2a31fd32928f service nova] Creating event network-vif-deleted:061e4f39-0a38-4fd6-be32-3578a95899ef for instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 on hv-cinder-85103 Jul 26 15:36:35.631375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-2399d309-6eee-43fd-8eb7-5c891fac667a req-85a61855-8c88-42e8-8c78-2a31fd32928f service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034554 Jul 26 15:36:35.632439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 100/190] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:36:35.876796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:35.877417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:35.884141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:35.884511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:35.885437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:35.885877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:36.073846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:36.080095 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-93dbc8b5-b289-4ea3-95c6-20926dfd6798 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.208739 Jul 26 15:36:36.080715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 91/191] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:35 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:36.611325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:36.621047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:36.626765 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:36.627211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:36.627987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:36.628426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:36.667868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:36.668310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:36.669216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lazy-loading 'fault' on Instance uuid 31cff2e3-818a-4ae8-8593-48a9ee36df41 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:36:36.718920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '858548bfa9b7455cb518849f31471865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417b9d6cde90467ebe75c790867a8c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:36.726870 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4aa58e73-214b-499b-8371-cfdbac8de456 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 200 len: 1353 microversion: 2.1 time: 0.120256 Jul 26 15:36:36.729309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 101/192] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:36 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 1353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:37.101947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:37.102422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:37.109284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.117445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.117445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.117445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.289995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:37.298241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4073ad24-5a42-4631-8c7d-3b721b8e99b1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.200143 Jul 26 15:36:37.298824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 92/193] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:37 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:37.748694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:37.749570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:37.756783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.757522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.759332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.759886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.776380 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] HTTP exception thrown: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Request method failure captured: Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 HTTP/1.1 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am_9hlxeZ--PvoZn6iE6Kx7HMxnl7sFWaUMz_5bEjcgdjITj2SSUgqZUqOcpnnRsl1FJcAWrKVCGKjmlMdV1fe43eqUYEFOx-j_LCI_WwHpzorWjwCs3FtZXJzVhpziVgCDBG9Xg5jWR3EdbRS5uD_pdUV6dRQH6Mt4rOKvQQ_CYvA Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:36:37.781999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/417b9d6cde90467ebe75c790867a8c89"}]}] Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 858548bfa9b7455cb518849f31471865 Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.783518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '31cff2e3-818a-4ae8-8593-48a9ee36df41'} Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:36:37.784487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.785877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.790941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Returning 404 to user: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:36:37.790941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a621985b-fdc7-4708-8f82-8b270e4c9279 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 404 len: 111 microversion: 2.1 time: 0.041666 Jul 26 15:36:37.790941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 102/194] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:37 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:36:37.907946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:37.910263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:37.916393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.916896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.917958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:37.918318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:37.931834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] HTTP exception thrown: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Request method failure captured: Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41/os-volume_attachments HTTP/1.1 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am_9hlxeZ--PvoZn6iE6Kx7HMxnl7sFWaUMz_5bEjcgdjITj2SSUgqZUqOcpnnRsl1FJcAWrKVCGKjmlMdV1fe43eqUYEFOx-j_LCI_WwHpzorWjwCs3FtZXJzVhpziVgCDBG9Xg5jWR3EdbRS5uD_pdUV6dRQH6Mt4rOKvQQ_CYvA Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:36:37.936944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/417b9d6cde90467ebe75c790867a8c89"}]}] Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 858548bfa9b7455cb518849f31471865 Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.938294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'server_id': '31cff2e3-818a-4ae8-8593-48a9ee36df41'} Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:36:37.939180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:37.940457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:36:37.941740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Returning 404 to user: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:36:37.941740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-01eec0e6-4974-4b49-a825-cbda9b755a8b tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034787 Jul 26 15:36:37.941740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 93/195] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:36:37 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:36:38.320114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:38.321121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:38.323155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:38.329178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:38.329504 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:38.330552 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:38.332158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:38.354188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:38.470474 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:38.477938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-22e29e72-c67a-4816-be08-549a67c5fc90 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.162642 Jul 26 15:36:38.478497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 103/196] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:38 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:39.498856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:39.499490 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:39.506050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.506596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.507451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.507892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.609541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:39.610643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:39.620293 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.621147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.622670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.623537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.640871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] HTTP exception thrown: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Request method failure captured: Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 HTTP/1.1 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am_9hlxeZ--PvoZn6iE6Kx7HMxnl7sFWaUMz_5bEjcgdjITj2SSUgqZUqOcpnnRsl1FJcAWrKVCGKjmlMdV1fe43eqUYEFOx-j_LCI_WwHpzorWjwCs3FtZXJzVhpziVgCDBG9Xg5jWR3EdbRS5uD_pdUV6dRQH6Mt4rOKvQQ_CYvA Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:36:39.642951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/417b9d6cde90467ebe75c790867a8c89"}]}] Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 858548bfa9b7455cb518849f31471865 Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.644129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '31cff2e3-818a-4ae8-8593-48a9ee36df41'} Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:36:39.644814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.645844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.647870 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Returning 404 to user: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:36:39.649026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f6c32827-aefa-440f-a756-02c1150fa996 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "DELETE /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 404 len: 111 microversion: 2.1 time: 0.045937 Jul 26 15:36:39.649773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 104/197] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:36:39 2022] DELETE /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:36:39.658359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:39.659224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] [instance: 31cff2e3-818a-4ae8-8593-48a9ee36df41] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:39.659356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:39.665539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.666010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.667176 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:39.667530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:39.669187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-50df61be-9462-4a46-a275-39ca64b7945e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.174251 Jul 26 15:36:39.670368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 94/198] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:39 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:39.695835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] HTTP exception thrown: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Request method failure captured: Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 HTTP/1.1 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am_9hlxeZ--PvoZn6iE6Kx7HMxnl7sFWaUMz_5bEjcgdjITj2SSUgqZUqOcpnnRsl1FJcAWrKVCGKjmlMdV1fe43eqUYEFOx-j_LCI_WwHpzorWjwCs3FtZXJzVhpziVgCDBG9Xg5jWR3EdbRS5uD_pdUV6dRQH6Mt4rOKvQQ_CYvA Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:36:39.697377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/417b9d6cde90467ebe75c790867a8c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/417b9d6cde90467ebe75c790867a8c89"}]}] Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 417b9d6cde90467ebe75c790867a8c89 Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-DeleteServersTestJSON-1459300996 Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 858548bfa9b7455cb518849f31471865 Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-DeleteServersTestJSON-1459300996-project Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.699078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '31cff2e3-818a-4ae8-8593-48a9ee36df41'} Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:36:39.703519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. Jul 26 15:36:39.705246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:36:39.706407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] Returning 404 to user: Instance 31cff2e3-818a-4ae8-8593-48a9ee36df41 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:36:39.706407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0a028ec6-d99d-41af-831e-4d091449bb43 tempest-DeleteServersTestJSON-1459300996 tempest-DeleteServersTestJSON-1459300996-project] 10.222.0.128 "GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41" status: 404 len: 111 microversion: 2.1 time: 0.045270 Jul 26 15:36:39.706407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 105/199] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:39 2022] GET /compute/v2.1/servers/31cff2e3-818a-4ae8-8593-48a9ee36df41 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:36:40.691352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:40.691956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:40.698306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:40.698750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:40.699511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:40.699976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:40.855431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:40.864865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f8893c0a-c7dc-4b1c-8cb8-2b979eb3843d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.177300 Jul 26 15:36:40.866001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 95/200] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:40 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:41.887259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:41.887907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:41.902817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:41.903274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:41.905042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:41.905914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:42.179113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:42.187776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a97d1b4f-d504-469c-a878-d0c4292f10c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.304899 Jul 26 15:36:42.188363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 106/201] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:41 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:43.211812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:43.212540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:43.214820 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=48 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:43.221902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:43.222673 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:43.223604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:43.224159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:43.444055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:43.463151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-44c51c55-6a1d-4185-ad4f-40b296f00ebc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.255191 Jul 26 15:36:43.466100 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 96/202] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:43 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:44.493538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:44.499357 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:44.507883 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:44.507883 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:44.508123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:44.508551 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:44.717424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:44.726273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-44c17e57-6207-4395-89a7-c8c011781fa6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.236282 Jul 26 15:36:44.728213 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 107/203] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:44 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:45.750117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:45.750728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:45.760167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:45.760167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:45.760167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:45.760167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:45.908925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:45.916881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1fbf4ab1-c905-43a3-b846-f24cbb792740 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.170721 Jul 26 15:36:45.917631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 97/204] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:45 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:46.938758 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:46.939376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:46.946692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:46.947394 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:46.948182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:46.948839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:47.127422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:47.132762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c1ed7e59-68ee-4c20-abc8-656443efb51a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.198116 Jul 26 15:36:47.133369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 108/205] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:46 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:48.155700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:48.161367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:48.176452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:48.176928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:48.178352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:48.178793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:48.369503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:48.380940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aebf25f6-22a1-47de-aac8-ca235f73e9d6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.229099 Jul 26 15:36:48.381577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 98/206] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:48 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:49.410660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:49.412219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:49.420574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:49.421141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:49.422050 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:49.422553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:49.813311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:49.825951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d4ec7793-a0a1-439e-a879-6a270c70ee8b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.420106 Jul 26 15:36:49.840041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 109/207] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:49 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:50.847760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:50.848388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:50.869053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:50.870208 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:50.871871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:50.874059 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:51.047435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:51.055060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a1e669b6-ae35-4d9c-8f06-0c09e0d77f31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1526 microversion: 2.1 time: 0.211114 Jul 26 15:36:51.055631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 99/208] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:50 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:52.078376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:52.081677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:52.086228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:52.086747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:52.087735 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:52.088260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:52.237579 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:52.247817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-728ebbd2-ce3e-45d2-babd-1aee3cee806d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1506 microversion: 2.1 time: 0.175945 Jul 26 15:36:52.249871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 110/209] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:52 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:52.269794 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:52.271366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:52.281396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:52.281396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:52.282464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:52.283069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:52.479797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:52.492856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e4b6ebaf-3b31-4291-a050-ab4da77c74fb tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1518 microversion: 2.1 time: 0.226828 Jul 26 15:36:52.493358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 100/210] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:52 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1518 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:54.515691 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:54.520905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:54.532443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:54.532925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:54.533926 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:54.534379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:54.559158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'flavor' on Instance uuid 0f12547e-bcd6-45c7-afee-0e20f7929840 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:36:55.125014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6c60fe65-ba38-4436-bf93-006ab6eb1ca7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/action" status: 200 len: 32 microversion: 2.1 time: 0.617886 Jul 26 15:36:55.125462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 111/211] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:36:54 2022] POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/action => generated 32 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:36:55.137043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:55.137657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:55.145808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:55.146277 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:55.150815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:55.150815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:55.287312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:55.298467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce08218c-95b6-4537-8a99-6592299e117a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.167222 Jul 26 15:36:55.299378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 101/212] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:55 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:56.321268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:56.322240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:56.329643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:56.330092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:56.330864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:56.331340 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:56.484344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:56.491968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f3503c11-71ce-4b29-a1dd-852944288d09 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.174774 Jul 26 15:36:56.492569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 112/213] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:56 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:57.514997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:57.514997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:57.520872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:57.521321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:57.522087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:57.522621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:57.659734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:57.667221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b0595236-c548-4eb0-87ca-c130e71fdb38 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.157648 Jul 26 15:36:57.682428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 102/214] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:57 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:58.689457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:58.690108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:58.697127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:58.697574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:58.698347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:58.698912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:58.886478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:58.895071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3f6c65ce-b742-4f2c-b060-636da26fb5a1 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.210194 Jul 26 15:36:58.895983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 113/215] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:58 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:59.916834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:59.917476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:59.924675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:59.925122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:59.925919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:59.926351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:00.081560 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:00.089097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fe731f01-d231-4d5a-9a77-26750dcf5488 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.176393 Jul 26 15:37:00.089934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 103/216] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:36:59 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:01.110889 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:01.111494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:01.117975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:01.118417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:01.119197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:01.119633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:01.265585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:01.273439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8d203bc9-e29f-4263-a13c-2c31a507e961 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.166143 Jul 26 15:37:01.274006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 114/217] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:01 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:02.299068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:02.299672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:02.305659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:02.306111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:02.306875 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:02.307306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:02.312449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=95 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:02.448285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:02.457762 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b912931-b880-4b43-b732-560213eb401b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.163040 Jul 26 15:37:02.458477 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 104/218] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:02 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:03.481094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:03.481094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:03.489083 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:03.489609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:03.490392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:03.490820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:03.645166 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:03.655442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-932e4563-1bb2-4f3f-b312-f39bb35b29c0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.178651 Jul 26 15:37:03.656274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 115/219] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:03 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:04.677596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:04.678276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:04.685455 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:04.685906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:04.686676 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:04.687152 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:04.874973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:04.883069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f4f6b6e8-5988-4ee6-a146-35ee82cf3fe2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.209702 Jul 26 15:37:04.883653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 105/220] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:04 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:05.905546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:05.906795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:05.912704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:05.915948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:05.915948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:05.915948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:06.069405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:06.077949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0062fb06-faef-406f-a2ac-1770958dbfbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.177630 Jul 26 15:37:06.078531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 116/221] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:05 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:07.099094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:07.099954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:07.106076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:07.106505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:07.108796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:07.108796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:07.318333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:07.331422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d6477e34-bcd0-4dc6-8f91-63fcd42064f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.236131 Jul 26 15:37:07.332104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 106/222] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:07 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:08.367538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:08.368188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:08.376304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:08.376981 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:08.377767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:08.378254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:08.526524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:08.534508 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9b6d7da0-bf48-4ab5-b60f-c8adf65eba88 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.170841 Jul 26 15:37:08.535095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 117/223] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:08 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:09.556374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:09.557138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:09.563900 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:09.564389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:09.565261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:09.565706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:09.718805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:09.727066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-18d8e18a-fdf8-4339-b386-f0c40acb0ef5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.174542 Jul 26 15:37:09.727806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 107/224] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:09 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:10.752082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:10.753402 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:10.759596 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:10.760046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:10.760848 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:10.761446 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:10.913777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:10.931530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8ebba23a-2b5a-4469-8a1a-a2c99b052e8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.183679 Jul 26 15:37:10.932100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 118/225] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:10 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:11.955706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:11.956547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:11.962955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:11.963484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:11.964330 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:11.964876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:12.107904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:12.115727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-955e651c-9c54-4978-b8c9-321f813054a6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.165016 Jul 26 15:37:12.116307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 108/226] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:11 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:13.137581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:13.138204 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:13.142577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=32 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:13.146212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:13.151053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:13.151053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:13.151053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:13.151925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:13.283741 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:13.301516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0d194806-288a-48ac-9fe3-9f3704af34b5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.167677 Jul 26 15:37:13.302097 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 119/227] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:13 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:14.329445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:14.330039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:14.331976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=26 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:14.337021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:14.337482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:14.338252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:14.338688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:14.494522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:14.503254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0f7265fc-1b60-414e-bfbb-696f098ab2f3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.178132 Jul 26 15:37:14.503859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 109/228] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:14 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:15.525430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:15.526028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:15.534280 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:15.534721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:15.535481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:15.535908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:15.680297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:15.688407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-389188a3-30e6-422e-8691-9fae940c534c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.166811 Jul 26 15:37:15.689017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 120/229] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:15 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:16.710454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:16.711054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:16.718289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:16.718739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:16.719537 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:16.719970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:16.942974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:16.951287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8a02d651-0975-4040-987b-75bee98748c8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.244735 Jul 26 15:37:16.951639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 110/230] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:16 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:17.972964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:17.973577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:17.980228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:17.980778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:17.981580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:17.982079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:18.116988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:18.125363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4883453a-5432-4ede-bbdf-c26376c2b745 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.156757 Jul 26 15:37:18.126036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 121/231] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:17 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:19.146632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:19.147197 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:19.153274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:19.154321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:19.155085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:19.155517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:19.291495 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:19.300054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4c0d39ea-bffc-4a80-8d45-56b2cc63753d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.157316 Jul 26 15:37:19.304597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 111/232] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:19 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:20.321151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:20.321763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:20.329060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:20.329507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:20.330268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:20.330715 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:20.471230 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:20.478618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-83a617fd-e4d1-47ee-9057-a9a96d2f7f62 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.161681 Jul 26 15:37:20.479188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 122/233] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:20 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:20.792709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-816827629", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "networks": [{"uuid": "b5f8ab70-ca20-493f-94b9-bdf15637a6df"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:20.848007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] validate_networks() for [('b5f8ab70-ca20-493f-94b9-bdf15637a6df', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:37:21.217340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:37:21.217340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:37:21.217340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:37:21.217340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:37:21.217340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:37:21.226068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:21.226517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:21.227535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:21.228002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:21.247271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Getting quotas for project eb5cc7e509e84773bec86203332e38af. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:21.252439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Getting quotas for user 8c8e0d314c074eaa91f6b16c6777cf1e and project eb5cc7e509e84773bec86203332e38af. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:21.266278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:37:21.268614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:37:21.390031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4be15dbc-5b8c-466e-8afa-38d1ecbd3564 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.601364 Jul 26 15:37:21.390860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 112/234] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:37:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:37:21.402776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-328b578d-eb7f-4adb-b835-c7bd1220546d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:21.403874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-328b578d-eb7f-4adb-b835-c7bd1220546d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:21.481978 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-328b578d-eb7f-4adb-b835-c7bd1220546d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:21.500234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:21.501107 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:21.508838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-328b578d-eb7f-4adb-b835-c7bd1220546d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1217 microversion: 2.1 time: 0.108538 Jul 26 15:37:21.508838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 123/235] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:21 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:21.512477 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:21.513486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:21.515139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:21.515729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:21.688208 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:21.696703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9cd5513b-0e8c-46a4-96fc-bbfdfcbf95ea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.200660 Jul 26 15:37:21.709056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 113/236] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:21 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:22.528344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:22.528953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:22.536574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.537025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.537797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.538233 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.613914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:22.621653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3147aa3a-9611-4279-bd5c-6b66ebfb1f86 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1221 microversion: 2.1 time: 0.097332 Jul 26 15:37:22.622600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 124/237] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:22 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:22.720703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:22.721368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:22.731954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.739759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.739759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.739759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.744105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:22.744698 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:22.751728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.752333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.753223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.753758 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.784977 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9d7001e7-8a02-49e3-99ac-1c8480609884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/ips" status: 200 len: 151 microversion: 2.20 time: 0.046428 Jul 26 15:37:22.792349 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 125/238] 10.222.0.128 () {60 vars in 1294 bytes} [Tue Jul 26 15:37:22 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:37:22.916647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:22.925400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8d66f4ec-e635-44d6-b874-86c30f74cba2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1504 microversion: 2.1 time: 0.210026 Jul 26 15:37:22.926068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 114/239] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:22 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:22.949242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21f6e6b7-97bb-4371-bcaf-5f12011b3484"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:22.951763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:22.958829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.959491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.960411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:22.960902 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:22.987335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] HTTP exception thrown: Cannot 'attach_volume' instance 0f12547e-bcd6-45c7-afee-0e20f7929840 while it is in vm_state rescued Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Request method failure captured: Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/os-volume_attachments HTTP/1.1 Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 74 Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am6GpGsOgmODNq_wbmCNv7IogT8hHP3CLk4Y6q8hnPGDFBZdj2sLjrVY5DnRevgzo7I3H2FPXCqZUcDYpR_pmziYfgRgguD1-cA1cEEE7eQK1MTx1PU_ajeeybBk5FKYBslmtnz7G7xJl5JOEPQOU6NIV9MTZSVn3HyDDEpa_o5yOw Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: cc117969e9394769a471d512ce80734a Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:37:22.989677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_cc117969e9394769a471d512ce80734a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/cc117969e9394769a471d512ce80734a"}]}] Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: cc117969e9394769a471d512ce80734a Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: c2bf7ea384a142d1bc23b23ab503fca0 Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {"volumeAttachment": {"volumeId": "21f6e6b7-97bb-4371-bcaf-5f12011b3484"}} Jul 26 15:37:22.996824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Cannot 'attach_volume' instance 0f12547e-bcd6-45c7-afee-0e20f7929840 while it is in vm_state rescued Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'server_id': '0f12547e-bcd6-45c7-afee-0e20f7929840', 'body': {'volumeAttachment': {'volumeId': '21f6e6b7-97bb-4371-bcaf-5f12011b3484'}}} Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:37:22.998784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0f12547e-bcd6-45c7-afee-0e20f7929840 while it is in vm_state rescued Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:23.001895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0f12547e-bcd6-45c7-afee-0e20f7929840 while it is in vm_state rescued Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Returning 409 to user: Cannot 'attach_volume' instance 0f12547e-bcd6-45c7-afee-0e20f7929840 while it is in vm_state rescued {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-007debe8-abe7-4bc5-a983-8cc0664d7057 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046519 Jul 26 15:37:23.003200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 126/240] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:37:22 2022] POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 15:37:23.005447 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:23.006026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:23.035226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.035226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.035226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.035226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.275954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-84478c5d-c72b-477b-910f-35675e76a86f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/action" status: 202 len: 0 microversion: 2.1 time: 0.277964 Jul 26 15:37:23.276836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 115/241] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:37:22 2022] POST /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:37:23.285550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:23.286188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:23.294557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.295002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.295766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.306783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.484513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:23.506704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-61d97180-646c-4fc9-880f-ee53c5b79e8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.225181 Jul 26 15:37:23.507283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 127/242] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:23 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:23.648063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:23.649282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:23.658428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.659076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.660281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.660849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.736912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:23.744670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5480e70a-f125-4a30-bccf-9a00678f4251 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1269 microversion: 2.1 time: 0.101140 Jul 26 15:37:23.745249 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 116/243] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:23 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:23.857180 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:23.858082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:23.865216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.865663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.866471 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:23.866865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:23.893239 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-dceb309b-d463-47d6-9842-faf606039a5e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/ips" status: 200 len: 147 microversion: 2.1 time: 0.040785 Jul 26 15:37:23.894021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 128/244] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:37:23 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:24.534245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:24.534871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:24.541496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.541942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:24.542778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.543304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:24.725706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:24.735799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6ca7a0c7-dd57-4279-ab3f-275b509bfdbd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.205907 Jul 26 15:37:24.736411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 117/245] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:24 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:24.766151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:24.766783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:24.773146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.774034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:24.775070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.775660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:24.892725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:24.901223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-14ad9eb1-0166-424a-bdf5-caac9aa0521f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1275 microversion: 2.1 time: 0.139747 Jul 26 15:37:24.901725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 129/246] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:24 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:24.980508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:24.981711 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:24.997421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.997421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:24.997421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:24.997421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.032367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d35f714c-35d0-4000-a484-aefbbde49454 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/ips" status: 200 len: 145 microversion: 2.1 time: 0.062035 Jul 26 15:37:25.033289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 118/247] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:37:24 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/ips => generated 145 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:25.743588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78033d37-231d-4871-b7d7-6169e88cafa4"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:25.745909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:25.752788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.753240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.754001 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.754429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.757633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:25.758291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:25.764334 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.765335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.766170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.766608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.913651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:25.921187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-49baef4d-4fd8-4b76-85b6-8449977dd385 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.167605 Jul 26 15:37:25.921848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 119/248] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:25 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:25.926453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:25.927054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:25.932867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.933305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:25.934063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:25.934489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.069624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:26.072183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:26.078882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-53f4d334-4770-45f3-b84d-10e31c79fe78 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.155967 Jul 26 15:37:26.079442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 120/249] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:25 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:26.083911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:26.084428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:26.090668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.091190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.092216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.093499 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.118401 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lazy-loading 'flavor' on Instance uuid 466faeda-8564-46cd-a893-141a3ed7e409 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:37:26.553502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-61296220-a584-468d-a872-d0f9401c1946 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/action" status: 202 len: 0 microversion: 2.20 time: 0.472830 Jul 26 15:37:26.554113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 121/250] 10.222.0.128 () {62 vars in 1324 bytes} [Tue Jul 26 15:37:26 2022] POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:37:26.563843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:26.564600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:26.571442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.571893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.572704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.573138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.712155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:26.721346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:26.722838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:26.723988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d98cfd97-754e-48a5-a269-90967beb472e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.165164 Jul 26 15:37:26.724562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 122/251] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:26 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:26.942801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:26.943404 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:26.950405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.950850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:26.951606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:26.952629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:27.094882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:27.103692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a8611e85-547f-49db-8205-b59f9118022b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.163729 Jul 26 15:37:27.103692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 123/252] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:26 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:27.108570 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:27.109160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:27.115489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:27.116038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:27.117087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:27.117626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:27.255753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:27.263542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62e42e32-66ec-4f36-9c99-33e33883917d tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.158921 Jul 26 15:37:27.264126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 124/253] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:27 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:27.747714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:27.748322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:27.755143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:27.755596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:27.756370 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:27.756833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:27.885767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:27.894372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:27.895998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:27.897312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eb0936cb-cf33-42d3-ba04-9e79f1f28533 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.153462 Jul 26 15:37:27.904183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 125/254] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:27 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:28.126093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:28.126740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:28.132694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.133135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:28.133942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.134321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:28.268378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:28.276815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-94dc0997-3083-43e7-8df5-760724f40636 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.155578 Jul 26 15:37:28.277564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 126/255] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:28 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:28.285150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:28.285752 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:28.291663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.292169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:28.293022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.293453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:28.423816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:28.431268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e01ea810-7d3d-4a57-94a8-62fccc5deba7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.150897 Jul 26 15:37:28.431829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 127/256] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:28 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:28.921043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:28.921911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:28.928036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.928514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:28.929285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:28.929720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:29.063998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:29.072342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:29.073873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:29.075074 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c49500da-f94b-4603-ad21-52d3506dc47c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.158211 Jul 26 15:37:29.075639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 128/257] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:28 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:29.297770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:29.298377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:29.304270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:29.304743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:29.305499 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:29.305938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:29.434842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:29.443557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-622f62f5-1a39-4a94-af12-dfeedab2d9fc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1512 microversion: 2.1 time: 0.149426 Jul 26 15:37:29.444129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 129/258] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:29 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:29.454770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:29.455374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:29.463594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:29.464037 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:29.464828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:29.465253 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:29.600270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:29.606621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7f9bdb69-2476-4a94-ac8c-324c7602a98f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.156155 Jul 26 15:37:29.607179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 130/259] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:29 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:30.099219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:30.099944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:30.106416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.106866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:30.107632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.108647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:30.282407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:30.292001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:30.294623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:30.296578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9dac22dd-6293-4b21-bf9b-a7409bed4fd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.201891 Jul 26 15:37:30.297371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 131/260] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:30 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:30.348177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77e62d4e-6abf-45af-8e39-7eaba129c338"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:30.354588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:30.364762 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.365212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:30.366321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.366751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:30.876645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7ffbd650-26f7-4ede-813c-df140ac3da0c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.136862 Jul 26 15:37:30.880634 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 130/261] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:37:25 2022] POST /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 194 bytes in 5139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:30.883430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:30.884483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:30.893179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.893616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:30.894700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:30.895142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.235780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:31.261013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:31.396417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:31.405955 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5232778d-6bc3-48dd-b65b-534fc5b8715b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1518 microversion: 2.1 time: 0.527048 Jul 26 15:37:31.406528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 131/262] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:30 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1518 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:31.411098 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:31.411877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:31.417651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:31.418103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.418873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:31.419293 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.506641 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:31.627406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:31.638237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5a094ce8-8256-42a0-b1bd-1a1cdac72821 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.230686 Jul 26 15:37:31.639758 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 132/263] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:31 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:31.657710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-dbbc6688-1cc9-4d04-ad39-823356ce62b0 req-984657e1-3c11-4e1a-ad17-567751137edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba", "tag": "0b4dffbb-d1b0-4bec-8fb6-4cf38629e370"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:31.673983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-dbbc6688-1cc9-4d04-ad39-823356ce62b0 req-984657e1-3c11-4e1a-ad17-567751137edc service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:31.674423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-dbbc6688-1cc9-4d04-ad39-823356ce62b0 req-984657e1-3c11-4e1a-ad17-567751137edc service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.692483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-dbbc6688-1cc9-4d04-ad39-823356ce62b0 req-984657e1-3c11-4e1a-ad17-567751137edc service nova] Creating event network-changed:0b4dffbb-d1b0-4bec-8fb6-4cf38629e370 for instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba on hv-cinder-85103 Jul 26 15:37:31.698260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-dbbc6688-1cc9-4d04-ad39-823356ce62b0 req-984657e1-3c11-4e1a-ad17-567751137edc service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045177 Jul 26 15:37:31.699168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 133/264] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:31.706489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:31.707176 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:31.714123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:31.714570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.715625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:31.716115 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:31.945360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:31.954203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:31.955717 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:31.957028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f08d6ddd-9965-4190-918c-ad7b4f1e4bd0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.255315 Jul 26 15:37:31.957593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 134/265] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:31 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:32.327543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b64b7895-90ec-4192-b12a-961476321bfd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.983258 Jul 26 15:37:32.336783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 132/266] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:37:30 2022] POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments => generated 194 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:37:32.660986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:32.661552 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:32.668642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:32.669089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:32.669900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:32.670537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:32.827605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:32.838152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-561192e2-09aa-4dcd-bb31-a6ffb5539450 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.180858 Jul 26 15:37:32.839218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 135/267] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:32 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:32.983565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:32.984270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:32.992833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:32.993286 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:32.994135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:32.994571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:33.138421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:33.146684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:33.148230 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:33.149436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c8b73714-77df-4e96-8ebf-c33104f86b39 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.171063 Jul 26 15:37:33.150004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 133/268] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:32 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:33.443922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-04b1ebfa-6cd6-4c62-b019-134a69249d3b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: .version_select at 0x7f346adcc0d0>, body: {"keypair": {"name": "tempest-keypair-2017805854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHOqpH3UmjQkP36PyoTsi9WUXbeK9jZ77ttB5t70gT4Kf6VmN+j2B2NzBmz36q/oBkLoIb57SLqg3Eg1qC3CrU5FPRi2w5VfT6x17s9SJ/QzpT4896PNP3B/Xfdj3VHTw=="}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:33.462197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-04b1ebfa-6cd6-4c62-b019-134a69249d3b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for project cc117969e9394769a471d512ce80734a. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:33.466546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-04b1ebfa-6cd6-4c62-b019-134a69249d3b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for user c2bf7ea384a142d1bc23b23ab503fca0 and project cc117969e9394769a471d512ce80734a. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:33.567389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-04b1ebfa-6cd6-4c62-b019-134a69249d3b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127252 Jul 26 15:37:33.568086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 136/269] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:37:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:33.861418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:33.862037 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:33.868311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:33.868782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:33.869718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:33.870393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:33.876008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:34.163152 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:34.171007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b1082e25-ef30-4ff2-88ec-ad4a4aa1de2f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.314443 Jul 26 15:37:34.171596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 134/270] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:33 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:34.173702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:34.174540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:34.187425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:34.188484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:34.191822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:34.191822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:34.391524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:34.400509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:34.402006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:34.403158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-152af7ad-315e-47fa-ad8b-f17414764d7f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.234139 Jul 26 15:37:34.403714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 137/271] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:34 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:35.193558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:35.194511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:35.201339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:35.202495 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:35.203642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:35.204073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:35.367669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:35.377467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-919147c9-a456-491d-bd26-2ca7fa7c86fe tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.188067 Jul 26 15:37:35.379889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 135/272] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:35 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:35.427538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:35.428344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:35.435158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:35.442537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:35.442537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:35.442537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:35.442537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:35.675054 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:35.683075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:35.689773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:35.689773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cdea1ed0-06cd-42c0-858f-0e2cac9796bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.263017 Jul 26 15:37:35.689773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 138/273] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:35 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:36.399254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:36.399921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:36.410934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:36.411578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:36.412548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:36.413138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:36.597903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:36.605728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a35b3dd7-a93f-4574-b398-c24a925e72da tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.210301 Jul 26 15:37:36.606410 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863460073", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b2c9ca8-7a56-40ff-881c-039976281dd4"}], "security_groups": [{"name": "tempest-securitygroup--1075133467"}], "key_name": "tempest-keypair-2017805854", "user_data": "}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:36.607047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 136/274] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:36 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:36.714093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:36.714661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:36.721601 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:36.727540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:36.728434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:36.729083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:36.772275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] validate_networks() for [('3b2c9ca8-7a56-40ff-881c-039976281dd4', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:37:36.931848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:36.955260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:36.960263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:36.961608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-df7bfc4d-2a21-4f91-b1a0-f60ba7b602dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.252798 Jul 26 15:37:36.964789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 137/275] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:36 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:37.069772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-15c99643-f93d-41ee-bce1-23e00e0688cf req-2020204e-7eb3-4c8f-aeff-f815b76758e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba", "name": "network-vif-plugged", "status": "completed", "tag": "0b4dffbb-d1b0-4bec-8fb6-4cf38629e370"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:37.082071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-15c99643-f93d-41ee-bce1-23e00e0688cf req-2020204e-7eb3-4c8f-aeff-f815b76758e3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:37.082554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-15c99643-f93d-41ee-bce1-23e00e0688cf req-2020204e-7eb3-4c8f-aeff-f815b76758e3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:37.094108 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-15c99643-f93d-41ee-bce1-23e00e0688cf req-2020204e-7eb3-4c8f-aeff-f815b76758e3 service nova] Creating event network-vif-plugged:0b4dffbb-d1b0-4bec-8fb6-4cf38629e370 for instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba on hv-cinder-85103 Jul 26 15:37:37.099442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-15c99643-f93d-41ee-bce1-23e00e0688cf req-2020204e-7eb3-4c8f-aeff-f815b76758e3 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 Jul 26 15:37:37.100048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 138/276] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:37.304090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:37:37.304732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:37:37.305416 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:37:37.306199 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:37:37.307004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:37:37.333406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:37.334031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:37.335201 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:37.335823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:37.361853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:37.367911 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Getting quotas for user c2bf7ea384a142d1bc23b23ab503fca0 and project cc117969e9394769a471d512ce80734a. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:37.382536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:37:37.384877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:37:37.515884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a80ab019-ea53-4c5f-9ccf-6b270c3a67fa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.914637 Jul 26 15:37:37.516888 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 139/277] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:37:36 2022] POST /compute/v2.1/servers => generated 411 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:37:37.530436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d10b63e0-9c49-4044-8a0a-de524c812269 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:37.531850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d10b63e0-9c49-4044-8a0a-de524c812269 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:37.600582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d10b63e0-9c49-4044-8a0a-de524c812269 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:37.612767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d10b63e0-9c49-4044-8a0a-de524c812269 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1249 microversion: 2.1 time: 0.088514 Jul 26 15:37:37.628085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 139/278] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:37 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:37.629267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:37.629918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:37.639454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:37.639972 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:37.640834 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:37.641542 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:37.819755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:37.828371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-69956ced-bd3d-464d-a93d-597493e55bc3 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.204210 Jul 26 15:37:37.829474 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 140/279] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:37 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:37.992446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:37.993315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:38.001813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.003972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:38.003972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.003972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:38.199796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:38.208692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:38.210213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:38.211486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2062f247-5b81-4ece-b7d3-4579e63c2011 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.224416 Jul 26 15:37:38.212066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 140/280] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:37 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:38.634532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:38.635286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:38.642828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.643380 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:38.644138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.644600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:38.711729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:38.724491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4acf1f3b-e09a-4530-9391-7f163e3c154c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1253 microversion: 2.1 time: 0.093586 Jul 26 15:37:38.725738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 141/281] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:38 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1253 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:38.848927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:38.849546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:38.856131 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.856613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:38.857449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:38.857894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:39.024643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:39.037953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-70331b91-883a-464d-bc46-1650ef17a9cf tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1317 microversion: 2.1 time: 0.192366 Jul 26 15:37:39.039111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 141/282] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:38 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:39.237137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:39.237750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:39.244180 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:39.244662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:39.245430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:39.245860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:39.385451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:39.394095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:39.395592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:39.396779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5669e04f-ac08-4df5-b31a-50c43d0b2b76 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.165282 Jul 26 15:37:39.397335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 142/283] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:39 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:39.748986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:39.749745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:39.757428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:39.759862 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:39.760872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:39.761323 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:39.828608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:39.836476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c68a0adc-9484-49df-b48a-a4a74b4ca96f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1253 microversion: 2.1 time: 0.091216 Jul 26 15:37:39.838763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 142/284] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:39 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:40.065087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:40.065705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:40.072955 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.073878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.074288 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.074719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.220766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:40.228676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5b55422b-4cf9-46f0-9f76-46b8cc222093 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1501 microversion: 2.1 time: 0.169576 Jul 26 15:37:40.229251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 143/285] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:40 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:40.419245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:40.420063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:40.426823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.427281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.428106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.428581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.569691 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:40.580652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:40.582605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:40.584081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-069b250a-7b77-47ce-867e-b1fb9a90ac14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.168892 Jul 26 15:37:40.584710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 143/286] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:40 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:40.859489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:40.860302 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:40.868493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.869070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.870031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:40.870528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:40.972100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:40.980164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1daf5d9f-fe02-4115-9c3b-090d85b564c9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1245 microversion: 2.1 time: 0.125967 Jul 26 15:37:40.980780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 144/287] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:40 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:41.391890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:41.392393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:41.398707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.399163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.400114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.400736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.430999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:37:41.609289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:41.614094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:41.616936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.617383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.618156 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.618593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.738928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-278630b1-a8b0-42e9-a181-f16a37e04f8b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "DELETE /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 204 len: 0 microversion: 2.1 time: 0.350991 Jul 26 15:37:41.739775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 144/288] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:37:41 2022] DELETE /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:37:41.751522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:41.752522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:41.758982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.759429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.760239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:41.761025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:41.775668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:41.786632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:41.789097 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:41.789983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f5be38b7-b62b-456e-b39e-f67ca70ba290 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.184670 Jul 26 15:37:41.790673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 145/289] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:41 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:41.936547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:41.941244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a56f7e3a-c349-4c1b-9346-05268f1eb23a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1507 microversion: 2.1 time: 0.196909 Jul 26 15:37:41.949722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 145/290] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:41 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:42.006066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:42.006690 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:42.014466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.015570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:42.016485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.017028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:42.083445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:42.091498 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0c62e88d-1d00-4f43-9335-036186ae93ad tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1301 microversion: 2.1 time: 0.089572 Jul 26 15:37:42.092387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 146/291] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:42 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:42.271024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1dc3acc3-4995-47e6-be27-ba97c47cdd94 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: .version_select at 0x7f346b5a90d0>, body: {"keypair": {"name": "tempest-keypair-1215107714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3xfwqXs2iUKPnyVfH6OihDoxoEdBmTHASZVL7U3m8d11I1vaxQtYIulhTesjI1xGCeLtjmL30HLdCMQidGK/9S6CfCx3Y/lERPAlf2kIUISXhqdXEHMXny84d9j7majg=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:42.292358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-1dc3acc3-4995-47e6-be27-ba97c47cdd94 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:42.295330 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:42.297663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-1dc3acc3-4995-47e6-be27-ba97c47cdd94 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:42.432239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1dc3acc3-4995-47e6-be27-ba97c47cdd94 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165197 Jul 26 15:37:42.433261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 146/292] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:37:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:42.814750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:42.815343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:42.822591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.823038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:42.823866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.824303 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:42.964132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:42.964824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:42.972453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.972927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:42.973902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:42.974339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:43.023623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:43.033331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:43.037807 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:43.039406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7ba84c8e-1354-4726-913c-c4786dfb5379 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.229534 Jul 26 15:37:43.040205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 147/293] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:42 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:43.114216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:43.114832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:43.127415 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:43.129913 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:43.132538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:43.132986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:43.148012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:43.156917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dafadbcc-0741-4bc6-a40c-318682bbc6ef tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1507 microversion: 2.1 time: 0.196589 Jul 26 15:37:43.157427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 147/294] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:42 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:43.202625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:43.211384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e5ec8134-7b96-48f0-803f-f292732faaa2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1309 microversion: 2.1 time: 0.101510 Jul 26 15:37:43.211384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 148/295] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:43 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:44.064542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:44.065154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:44.077355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.078123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.079292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.079954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.191638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:44.192591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:44.198874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:44.221177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.224271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.227012 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.230226 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.275136 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:44.284808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:44.287355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:44.290533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aa06f1f0-855a-440c-b7e4-71122c5c791d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.231150 Jul 26 15:37:44.291169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 148/296] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:44 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:44.296853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:44.298041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:44.306940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.308011 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.309406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:44.310398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:44.409737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:44.420134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7beebbdc-ff18-488f-ac64-383ac44e6fce tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1309 microversion: 2.1 time: 0.127394 Jul 26 15:37:44.434026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 149/297] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:44 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:44.555096 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:44.575741 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9cc9b275-ef13-46a6-a3fa-e10c19f85e3a tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1507 microversion: 2.1 time: 0.392147 Jul 26 15:37:44.577668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 149/298] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:44 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:45.316297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:45.316982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:45.325653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.326096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.331166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.331769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.442760 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:45.444214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:45.473162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.474544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.475649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.477342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.605161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:45.616006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:45.621893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:45.623486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1471ce23-7895-42d0-a419-18526d206e34 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.312247 Jul 26 15:37:45.624595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 150/299] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:45 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:45.632797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:45.633622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:45.642407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.643012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.643980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.644410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.758441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:45.765638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:45.770226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-633a69db-b509-449e-87d3-00ae2112efb0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1465 microversion: 2.1 time: 0.144440 Jul 26 15:37:45.774441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 151/300] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:45 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:45.801282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:45.811644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ea721bbe-dcca-4c4e-8d85-ce817a79b1f2 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.372797 Jul 26 15:37:45.823427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-f33e81d9-c06d-4a92-bb4a-d0e373d0d468 req-14a684a2-8bf2-4174-b1af-0a069cdfbafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba", "name": "network-vif-deleted", "tag": "0b4dffbb-d1b0-4bec-8fb6-4cf38629e370"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:45.826407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 150/301] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:45 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:45.839779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f33e81d9-c06d-4a92-bb4a-d0e373d0d468 req-14a684a2-8bf2-4174-b1af-0a069cdfbafd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:45.840295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f33e81d9-c06d-4a92-bb4a-d0e373d0d468 req-14a684a2-8bf2-4174-b1af-0a069cdfbafd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:45.865477 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-318340264", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44aad34-88bd-4a3d-a4b4-00a0a6488a28"}], "security_groups": [{"name": "tempest-securitygroup--1660015274"}], "key_name": "tempest-keypair-1215107714", "user_data": "}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:45.868830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f33e81d9-c06d-4a92-bb4a-d0e373d0d468 req-14a684a2-8bf2-4174-b1af-0a069cdfbafd service nova] Creating event network-vif-deleted:0b4dffbb-d1b0-4bec-8fb6-4cf38629e370 for instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba on hv-cinder-85103 Jul 26 15:37:45.879489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-f33e81d9-c06d-4a92-bb4a-d0e373d0d468 req-14a684a2-8bf2-4174-b1af-0a069cdfbafd service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058383 Jul 26 15:37:45.880354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 152/302] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:46.107881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] validate_networks() for [('c44aad34-88bd-4a3d-a4b4-00a0a6488a28', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:37:46.649036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:46.650512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:46.659817 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.660892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:46.661886 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.662491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:46.846895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:46.857456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:46.859607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:46.861258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-042251ae-2ec4-4ffd-9c45-cbf6b4391f7c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.217921 Jul 26 15:37:46.862194 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 153/303] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:46 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:46.870190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:46.871755 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:46.879040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.879946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:46.881078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.881914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:46.955041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:46.964995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-65b9e083-ddff-47e0-890f-5cf8fb0b0687 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1465 microversion: 2.1 time: 0.101132 Jul 26 15:37:46.965665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 154/304] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:46 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1465 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:46.971954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:46.972855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:46.982264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.983656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:46.984991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:46.988180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.001859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:37:47.002389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:37:47.002645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:37:47.003058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:37:47.003470 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:37:47.023501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.024400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.025769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.026722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.067153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:47.072997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:47.086351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:37:47.089437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:37:47.196237 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:47.204668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-49a63ee9-40ea-4c48-be3f-e264b38b01d5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.237637 Jul 26 15:37:47.210076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 155/305] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:46 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:47.256130 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-8e8bc847-1dc1-4a3c-b1b9-d9e9822f6076 req-ebb49e32-0fc7-48e3-bd3f-da2dc949aca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:47.269741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8e8bc847-1dc1-4a3c-b1b9-d9e9822f6076 req-ebb49e32-0fc7-48e3-bd3f-da2dc949aca0 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.270692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8e8bc847-1dc1-4a3c-b1b9-d9e9822f6076 req-ebb49e32-0fc7-48e3-bd3f-da2dc949aca0 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.298678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8d5db23b-9bf1-44b9-bc80-97712420b3fa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.437739 Jul 26 15:37:47.301372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-8e8bc847-1dc1-4a3c-b1b9-d9e9822f6076 req-ebb49e32-0fc7-48e3-bd3f-da2dc949aca0 service nova] Creating event network-changed:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:37:47.309043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-8e8bc847-1dc1-4a3c-b1b9-d9e9822f6076 req-ebb49e32-0fc7-48e3-bd3f-da2dc949aca0 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057015 Jul 26 15:37:47.310158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 156/306] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:47.310892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 151/307] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:37:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:37:47.326874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7b6c179b-5c8b-41bd-9858-2681a13f5ce3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:47.328278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7b6c179b-5c8b-41bd-9858-2681a13f5ce3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:47.393482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7b6c179b-5c8b-41bd-9858-2681a13f5ce3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:47.422119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7b6c179b-5c8b-41bd-9858-2681a13f5ce3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1245 microversion: 2.1 time: 0.105504 Jul 26 15:37:47.423528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 157/308] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:47 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:47.895132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:47.895995 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:47.905753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.906215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.907144 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.907414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.989404 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:47.990143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:47.997656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.998101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.999039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.999484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.065545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.081015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.088561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.092622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ef8b1f10-c7f2-44c8-9bfd-8d86dd4ef294 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1465 microversion: 2.1 time: 0.105773 Jul 26 15:37:48.092773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.092888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 158/309] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:47 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1465 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:48.093309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d6b1ed60-c225-4f3f-beb5-3a7c338c30b6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.204607 Jul 26 15:37:48.094046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 152/310] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:47 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:48.225095 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:48.225760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:48.232083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:48.234887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.234887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:48.234887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.381435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.389744 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4ffaabb4-6ce7-481b-a829-cabb3eb0726a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.168348 Jul 26 15:37:48.394569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 159/311] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:48 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:48.443888 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:48.444416 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:48.451146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:48.451598 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.452400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:48.452861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.517087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.525117 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-69b3a932-f657-460a-85ac-3c016de057a7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1249 microversion: 2.1 time: 0.085479 Jul 26 15:37:48.525698 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 153/312] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:48 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:49.114636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:49.115226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:49.118253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:49.119461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:49.121923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.122368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.123203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.124332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.128810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.129270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.130047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.130476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.204738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.205733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.206193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lazy-loading 'fault' on Instance uuid 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:37:49.271582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.279613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bbb347bb-10a6-46c3-8d9a-7b5c18ce0265 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1307 microversion: 2.1 time: 0.172212 Jul 26 15:37:49.280508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 160/313] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:49 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:49.368401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.377212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.378731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.379931 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-11a250a3-857d-4bc4-bb35-286700af125d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.266211 Jul 26 15:37:49.380514 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 154/314] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:49 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:49.412346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:49.413357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:49.419592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.420102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.421485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.422081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.547622 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:49.548242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:49.554512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.554957 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.555723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.556161 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.567965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.581329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c47a1832-c685-4193-ba79-20848edf33d0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.172984 Jul 26 15:37:49.587273 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 161/315] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:49 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:49.618609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.626796 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7dd24c27-5216-465b-b1bd-c182be0f4fcb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1297 microversion: 2.1 time: 0.084047 Jul 26 15:37:49.627403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 155/316] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:49 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:50.309026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:50.310609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:50.320612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.321063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.322566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.322695 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.357654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.359482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.361213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lazy-loading 'fault' on Instance uuid 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:37:50.401330 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.407111 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:50.407603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:50.410963 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-08ddbcd5-9dde-4072-8091-d545ffee021e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 200 len: 1307 microversion: 2.1 time: 0.106811 Jul 26 15:37:50.411616 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 162/317] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:50 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:50.415070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.415904 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.416898 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.417526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.421158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:50.604250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:50.604946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:50.611522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.612509 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.612990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.613792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.614224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.619786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.621370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.622502 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-198ccf7a-64e4-41f9-ab2b-93d7376774e2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.220106 Jul 26 15:37:50.623066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 156/318] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:50 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:50.648322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:50.648967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:50.656090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.656586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.657368 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.657798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.730139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.737836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-48550763-cfb1-4b51-8b55-336aec9ff45d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1297 microversion: 2.1 time: 0.093307 Jul 26 15:37:50.744577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 157/319] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:50 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:50.754622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.762129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-632e49bd-c923-4308-a69f-eb0550b083dd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.162017 Jul 26 15:37:50.762702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 163/320] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:50 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:51.435635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:51.435635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:51.440392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.440882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.441652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.442111 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.457069 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] HTTP exception thrown: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Request method failure captured: Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba HTTP/1.1 Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AooWNCXzuG43d7y3aeYR44L41SN1u4r3RlvFOxOQ3BKAF7RR_0l_ArZXdXHZi8ow2ZfPpYvXxmf8YKQuMVmE21ELowzFo_coNzM4xCzPJ6glaXyT6r8rYjEq07Ap_RnxlAYWdX1wZ7iU3FnsvtOL29EHWmZh1ifzP7mKiIaSIRXt-Q Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: eb5cc7e509e84773bec86203332e38af Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesActionsTest-943674698 Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:37:51.458719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/eb5cc7e509e84773bec86203332e38af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_eb5cc7e509e84773bec86203332e38af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/eb5cc7e509e84773bec86203332e38af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/eb5cc7e509e84773bec86203332e38af"}]}] Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesActionsTest-943674698 Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: eb5cc7e509e84773bec86203332e38af Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesActionsTest-943674698 Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesActionsTest-943674698-project Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 8c8e0d314c074eaa91f6b16c6777cf1e Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesActionsTest-943674698-project Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. Jul 26 15:37:51.459956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba'} Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:37:51.460861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. Jul 26 15:37:51.462217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:37:51.463407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Returning 404 to user: Instance 0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:37:51.463407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1ac85058-f116-4b07-b407-8687f5542d34 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba" status: 404 len: 111 microversion: 2.1 time: 0.031096 Jul 26 15:37:51.463977 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 158/321] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:51 2022] GET /compute/v2.1/servers/0a6a11b8-b40e-4f11-85e4-d3e4e98be5ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:37:51.625186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-180381068", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "networks": [{"uuid": "b5f8ab70-ca20-493f-94b9-bdf15637a6df"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:51.646263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:51.647009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:51.653189 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.653637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.654401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.655710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.693623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] validate_networks() for [('b5f8ab70-ca20-493f-94b9-bdf15637a6df', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:37:51.806124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:51.815232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:51.816803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:51.817964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8ffa0069-48e0-4c53-9cd0-57fed8289dff tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.175591 Jul 26 15:37:51.818785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 159/322] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:51 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:51.838767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:51.843046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:51.846794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.847234 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.847994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.848425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.914829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:51.923541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ebde5f50-3743-4901-9539-1200ba6b80c8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1315 microversion: 2.1 time: 0.088557 Jul 26 15:37:51.924126 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 160/323] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:51 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:51.928693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:51.929251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:51.935150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.935610 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.936945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.937383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.081009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:52.088758 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-04b7288b-9bc7-4940-bb75-f659eb1147e8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.163525 Jul 26 15:37:52.089334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 161/324] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:51 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:52.090214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:37:52.090642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:37:52.091195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:37:52.091606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:37:52.092062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:37:52.101412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.105954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.105954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.105954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.120904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Getting quotas for project eb5cc7e509e84773bec86203332e38af. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:37:52.125860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Getting quotas for user 8c8e0d314c074eaa91f6b16c6777cf1e and project eb5cc7e509e84773bec86203332e38af. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:37:52.137003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:37:52.139355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:37:52.259803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-624ed4f2-0e0e-4bf9-a74a-284914ef91ee tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.638365 Jul 26 15:37:52.260453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 164/325] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:37:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:37:52.272749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bb784989-44bd-4d5b-8a56-926a4fb5dec6 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:52.273543 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bb784989-44bd-4d5b-8a56-926a4fb5dec6 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:52.329734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bb784989-44bd-4d5b-8a56-926a4fb5dec6 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:52.336970 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bb784989-44bd-4d5b-8a56-926a4fb5dec6 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1217 microversion: 2.1 time: 0.068072 Jul 26 15:37:52.337666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 162/326] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:52 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:52.842782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:52.843388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:52.849939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.850896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.851149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.851588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.945150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:52.945857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:52.953810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.954266 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.955047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.955485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.997313 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.006318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.007936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.009140 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d6f84456-e76f-47a7-a9a1-803e28139316 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.171356 Jul 26 15:37:53.010047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 165/327] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:52 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:53.023458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.031367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-abae69ff-ec7e-43d4-87b3-7641d16742a0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1315 microversion: 2.1 time: 0.090269 Jul 26 15:37:53.031940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 163/328] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:52 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1315 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:53.109773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:53.110414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:53.116756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.117590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.118173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.118620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.262328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.270634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-66263e2e-e98e-4767-bf6a-0e126642ea60 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.165431 Jul 26 15:37:53.271197 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 166/329] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:53 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:53.359065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:53.359678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:53.365864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.366303 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.367062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.367489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.432671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.441496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-16bad9a7-185a-4624-957c-df9d4e663a55 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1221 microversion: 2.1 time: 0.086383 Jul 26 15:37:53.442002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 164/330] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:53 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:54.034111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.034662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:54.041270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.041719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.042486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.042925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.051965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.052610 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:54.059390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.059838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.060665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.061150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.129175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.137197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e5634de2-0e78-4c66-ab02-abc2237dec8c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1315 microversion: 2.1 time: 0.089031 Jul 26 15:37:54.137783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 165/331] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:54 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1315 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:54.180344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.189200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.190702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.191882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-06b80dfb-8baa-4364-aa0d-0aa3842c957a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.162450 Jul 26 15:37:54.192435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 167/332] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:54 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:54.291039 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.291633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:54.299139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.299583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.300336 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.300795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.432962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.441996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-acf5e99b-fcc5-4a7e-84ff-3adb2e587bcc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.154663 Jul 26 15:37:54.442615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 166/333] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:54 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:54.463267 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.464516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:54.470833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.471283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.472055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.472530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.533760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:54.543870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ac6796ef-632b-4f7a-9e7f-e30401851607 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1221 microversion: 2.1 time: 0.084493 Jul 26 15:37:54.544630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 168/334] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:54 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:55.157728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:55.158287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:55.164713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.165158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.165918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.166353 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.215326 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:55.215931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:55.222217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.222753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.223440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.223889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.229526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.237650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-95e5aca3-ba08-4fc6-acc7-fcdefd16be9c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1315 microversion: 2.1 time: 0.083907 Jul 26 15:37:55.241312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 167/335] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:55 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1315 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:55.367406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.376187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.377830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.379172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9da2e306-ad69-472c-9486-dc598b12a4b8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.167828 Jul 26 15:37:55.379721 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 169/336] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:55 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:55.464583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:55.465015 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:55.471846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.472287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.473123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.473546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.566000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:55.566608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:55.573096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.573543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.574509 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:55.575084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:55.621486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.629810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c208bb3b-a540-45a9-ab9a-4acbb84d2ddf tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.170098 Jul 26 15:37:55.631105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 168/337] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:55 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:55.651397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:55.653760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:55.662319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b943d143-0c25-4cb7-96a6-0594461de159 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1221 microversion: 2.1 time: 0.100497 Jul 26 15:37:55.662884 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 170/338] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:55 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1221 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:56.262429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:56.263287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:56.270809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.271344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.272112 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.272822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.339423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.351996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ef9d2c4d-750e-4d3a-ac28-ad82869ead84 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1303 microversion: 2.1 time: 0.093008 Jul 26 15:37:56.353381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 169/339] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:56 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:56.402976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:56.404111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:56.413078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.413964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.415016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.417204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.623647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.633360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.635355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.636923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-253f5c46-e7c3-46cb-b1c0-f75acb6c9e3f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.237999 Jul 26 15:37:56.638013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 171/340] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:56 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:56.651551 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:56.654021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:56.660011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.660725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.661625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.662310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.684566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:56.685391 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:56.692458 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.694329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.694545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.695002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.778848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.797324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f9646049-eb29-4578-b9fb-09ec69c5675b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1269 microversion: 2.1 time: 0.118112 Jul 26 15:37:56.798434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 172/341] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:56 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:56.847232 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f10515a4-7fa9-47f2-b847-14e4a9b276e0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:56.853867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:56.857275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f10515a4-7fa9-47f2-b847-14e4a9b276e0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:56.858637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f10515a4-7fa9-47f2-b847-14e4a9b276e0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:56.865153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-15ac008c-c528-4e6c-a211-25a04ff50479 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.217671 Jul 26 15:37:56.876493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 170/342] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:56 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:56.953379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f10515a4-7fa9-47f2-b847-14e4a9b276e0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Going to try to stop instance {{(pid=124843) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:37:57.200675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f10515a4-7fa9-47f2-b847-14e4a9b276e0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action" status: 202 len: 0 microversion: 2.1 time: 0.356806 Jul 26 15:37:57.231914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 173/343] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:37:56 2022] POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:37:57.242797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:57.244224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:57.249692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=4 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:57.254419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.255115 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.256067 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.256600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.379125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:57.379750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:57.398781 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.399310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.400269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.400810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.415270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.426864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-16de5106-be9c-44be-a6ed-075f6422f043 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.189727 Jul 26 15:37:57.428100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 171/344] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:57 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:57.644844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.653909 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f4edb296-63e8-48a2-b68f-724d8d08a710 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.282194 Jul 26 15:37:57.655087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 174/345] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:57 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:57.667280 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:57.668393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:57.688068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.690179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.691170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.691413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.819671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:57.820379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:57.829401 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.830084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.831419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.831955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.906335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.915387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.916774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.917539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:57.918006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-79e6df40-cd5c-409b-8f5f-71155b84de19 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1748 microversion: 2.20 time: 0.256901 Jul 26 15:37:57.929249 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-426a8e5c-86c5-49f7-baf6-0ccdc2787e89 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1277 microversion: 2.1 time: 0.114252 Jul 26 15:37:57.930710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 175/346] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:57 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:57.932795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 172/347] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:57 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1748 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:37:57.936900 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:57.938354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:57.947174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.947678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:57.948480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:57.948924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.135262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:58.143572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-98d50342-bb46-40d8-9527-238d040df4d7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.210884 Jul 26 15:37:58.144073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 176/348] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:57 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:58.251621 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-de4c6ee9-1719-4a74-bdb2-4340ddd13a24 req-18e81b80-2a11-409d-8f94-083bf3344db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065d4125-a5c9-42f0-aaf7-4c8b7250c221", "tag": "1677bd44-b76c-4604-b1ac-43c7dded5da3"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:58.266122 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-de4c6ee9-1719-4a74-bdb2-4340ddd13a24 req-18e81b80-2a11-409d-8f94-083bf3344db0 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.266869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-de4c6ee9-1719-4a74-bdb2-4340ddd13a24 req-18e81b80-2a11-409d-8f94-083bf3344db0 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.281350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-de4c6ee9-1719-4a74-bdb2-4340ddd13a24 req-18e81b80-2a11-409d-8f94-083bf3344db0 service nova] Creating event network-changed:1677bd44-b76c-4604-b1ac-43c7dded5da3 for instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 on hv-cinder-85103 Jul 26 15:37:58.286761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-de4c6ee9-1719-4a74-bdb2-4340ddd13a24 req-18e81b80-2a11-409d-8f94-083bf3344db0 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038789 Jul 26 15:37:58.287376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 173/349] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:58.449789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:58.450615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:58.458219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.458895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.459670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.460101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.618829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:58.627314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e914fbb7-0df5-41fe-9bb5-e4f8377670ca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.181391 Jul 26 15:37:58.627888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 177/350] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:58 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:58.675869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:58.676511 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:58.682811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.683262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.684085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.684572 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.821141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:58.829738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d8ea3256-cfc9-466b-a0c3-2f5083d799bb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.158083 Jul 26 15:37:58.830309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 174/351] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:58 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:58.942704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:58.943552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:58.949895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.950339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.951099 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.952409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.952917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:58.953532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:58.959729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.960175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.960974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:58.961409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:58.967738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:59.105202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.114832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.115655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.117198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.118390 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e5d36e7a-1768-469f-b867-37ca4982b1dd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1748 microversion: 2.20 time: 0.179816 Jul 26 15:37:59.119202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 178/352] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:37:58 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1748 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:37:59.123106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9f74f810-ebdc-46e6-8c92-3954c8e5dff0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.174553 Jul 26 15:37:59.123846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 175/353] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:58 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:37:59.164968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:59.165747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:59.171889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.172345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:59.173150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.173586 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:59.366493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.377280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-80f5e3b6-8446-4661-931e-97e06b236795 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.215733 Jul 26 15:37:59.377701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 179/354] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:59 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:59.649462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:59.650072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:59.657985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.658429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:59.659194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.659630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:59.813023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:59.821388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-778f1e2d-49c6-41f9-a5dc-ec5e2609f1a5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.175711 Jul 26 15:37:59.822122 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 176/355] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:59 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:59.860417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:59.861058 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:59.868126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.868608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:59.869379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:59.869811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.009720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.018146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dcb28968-1401-4129-9319-bcfb4cbce5a9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.162066 Jul 26 15:38:00.018719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 180/356] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:37:59 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:00.144983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:00.145594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:00.146393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:00.147459 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:00.151740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.152661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.153759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.154872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.157719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.158445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.159708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.160488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.309609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.316827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.318440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-741d8134-8706-4c47-a3f5-ac16573654c0 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.177493 Jul 26 15:38:00.327143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.328770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.329991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5aa5a40e-6ef7-4e1e-867d-cae6e5895a4a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1748 microversion: 2.20 time: 0.191749 Jul 26 15:38:00.330551 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 177/357] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:00 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1748 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:00.332139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 181/358] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:00 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:00.399068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:00.399679 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:00.406485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.406934 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.407706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.408167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.546721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:00.554509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-21abfbbc-1f3d-4d72-9982-f8ddc5fbdaf5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.159791 Jul 26 15:38:00.558427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 178/359] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:00 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:00.845809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:00.846425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:00.853326 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.853645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.854582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:00.856760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:00.997377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.007149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-de77bad2-6065-47e0-93a7-6f69ec03807b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.165755 Jul 26 15:38:01.007873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 182/360] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:00 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:01.039354 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:01.039877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:01.047499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.047952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.048759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.049203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.203050 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.210775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-408803e0-79cf-40b6-8c16-2d318d4280b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.175396 Jul 26 15:38:01.211363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 179/361] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:01 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:01.338890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:01.339417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:01.341411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:01.347406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.347856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.348707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.349147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.354514 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:01.355553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:01.362427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.362850 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.363643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.364121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.507970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.520081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8420100-53f9-4419-a1fc-351589b606ea tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.184891 Jul 26 15:38:01.521240 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 183/362] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:01 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:01.573287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.578000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:01.578721 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:01.583925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.584825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.585360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.585672 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.586600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:01.586727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:01.587251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cf82f908-e402-419c-8ca3-c8c3c2bcc42f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1748 microversion: 2.20 time: 0.237494 Jul 26 15:38:01.587992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 180/363] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:01 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1748 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:01.776836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:01.785145 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7f3a52e6-33ca-4476-986d-c19bca366d8c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.211426 Jul 26 15:38:01.785819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 184/364] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:01 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:02.029569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:02.030836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:02.037849 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.038297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.039670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.039670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.187273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:02.195869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c18fd250-d9b5-4d6a-913c-a5b926b4c732 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.170401 Jul 26 15:38:02.196446 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 181/365] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:02 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:02.231410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:02.232039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:02.235292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:02.235967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=14 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:02.241234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.241735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.242479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.242916 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.543961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:02.545730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:02.551830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=18 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:02.553954 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.554685 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.555778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.556720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.608122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:02.621866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4d2d746f-bb28-46ac-9dbd-ef6b0ed04ef4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.394078 Jul 26 15:38:02.637521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 185/366] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:02 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:02.644420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:02.645419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:02.653016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.653470 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.654819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.655431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.672147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:02.852764 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:02.868280 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5c95574e-ebfc-4c44-a1ed-42c93620e5d8 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.328780 Jul 26 15:38:02.869249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 182/367] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:02 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:02.893349 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:02.894310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:02.911359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.912865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:02.915573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:02.917097 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.246362 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:03.265860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:03.267625 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:03.268861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c2c34a5e-d5b6-4c63-be14-dba1c9b9ef1f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1748 microversion: 2.20 time: 0.629365 Jul 26 15:38:03.273382 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 186/368] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:02 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1748 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:03.283008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-42e760cc-22a7-4029-999e-19345288a95a req-8a2a7f1f-8c0a-4263-bfa1-fede221fb4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "name": "network-vif-plugged", "status": "completed", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:03.300188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-42e760cc-22a7-4029-999e-19345288a95a req-8a2a7f1f-8c0a-4263-bfa1-fede221fb4e4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.300836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-42e760cc-22a7-4029-999e-19345288a95a req-8a2a7f1f-8c0a-4263-bfa1-fede221fb4e4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.328545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-42e760cc-22a7-4029-999e-19345288a95a req-8a2a7f1f-8c0a-4263-bfa1-fede221fb4e4 service nova] Creating event network-vif-plugged:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:38:03.341707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:03.348150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d9daeabf-bd86-4cd2-9e46-a48f066b8f8f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.465611 Jul 26 15:38:03.348657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-42e760cc-22a7-4029-999e-19345288a95a req-8a2a7f1f-8c0a-4263-bfa1-fede221fb4e4 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073471 Jul 26 15:38:03.350353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 187/369] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:03.352394 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 183/370] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:02 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:03.371425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:03.372132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:03.393231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.393855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.399080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.399979 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.644130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:03.645163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:03.658323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.659082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.664823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.677325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.681333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:03.710038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c17f2e71-014c-498a-be11-10538affa964 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.356184 Jul 26 15:38:03.712072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 188/371] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:03 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:03.893876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:03.894513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:03.921769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.922227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:03.923085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:03.923585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.247639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:04.261480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7ed789fa-bd40-4a6c-9eb2-0529f01abe0c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.371529 Jul 26 15:38:04.266410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 189/372] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:03 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:04.310809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:04.315383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:04.334651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.348337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.351251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.351907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.647447 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:04.660973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:04.665235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:04.668586 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-910dc3c8-0263-4ccf-baf2-755645fbcf25 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.374597 Jul 26 15:38:04.671298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 190/373] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:04 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:04.685484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:04.689598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:04.704287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.710282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.710282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.710282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.722036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:04.733961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-02533c94-5b43-4e80-ac63-9ca5e4f83c49 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 1.093874 Jul 26 15:38:04.740714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 184/374] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:03 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:04.748409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-1e78c085-5fbe-4653-9e45-a00483bd8064 req-e133cf38-860e-4997-a1a7-17d6dc34bce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12001b8e-4e0a-434b-a0a1-da91ba40d1ab", "tag": "1d2e29ba-8a5a-42e4-b7a5-95b96948355e"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:04.777245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-1e78c085-5fbe-4653-9e45-a00483bd8064 req-e133cf38-860e-4997-a1a7-17d6dc34bce6 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.781688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-1e78c085-5fbe-4653-9e45-a00483bd8064 req-e133cf38-860e-4997-a1a7-17d6dc34bce6 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.820574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-1e78c085-5fbe-4653-9e45-a00483bd8064 req-e133cf38-860e-4997-a1a7-17d6dc34bce6 service nova] Creating event network-changed:1d2e29ba-8a5a-42e4-b7a5-95b96948355e for instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab on hv-cinder-85103 Jul 26 15:38:04.843180 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-1e78c085-5fbe-4653-9e45-a00483bd8064 req-e133cf38-860e-4997-a1a7-17d6dc34bce6 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100815 Jul 26 15:38:04.844565 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 185/375] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:04.851744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:04.853268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:04.867885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.871661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:04.876274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:04.877239 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.008646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:05.017238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91844460-0b63-451d-990a-c1ac0fd88324 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.343840 Jul 26 15:38:05.018535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 191/376] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:04 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:05.143739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:05.166133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eb9a9764-ad75-4fa1-a7dc-37cbaf5e6eca tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.319882 Jul 26 15:38:05.169292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 186/377] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:04 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:05.283653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:05.284714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:05.308888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.308888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.308888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.308888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.368856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-4d392331-6765-4077-8767-e4b262df75a4 req-a720ee96-d673-4ab9-8de9-cd7e7f980440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "name": "network-vif-plugged", "status": "completed", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:05.394781 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4d392331-6765-4077-8767-e4b262df75a4 req-a720ee96-d673-4ab9-8de9-cd7e7f980440 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.395258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4d392331-6765-4077-8767-e4b262df75a4 req-a720ee96-d673-4ab9-8de9-cd7e7f980440 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.411742 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-4d392331-6765-4077-8767-e4b262df75a4 req-a720ee96-d673-4ab9-8de9-cd7e7f980440 service nova] Creating event network-vif-plugged:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:38:05.417509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-4d392331-6765-4077-8767-e4b262df75a4 req-a720ee96-d673-4ab9-8de9-cd7e7f980440 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053987 Jul 26 15:38:05.418411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 187/378] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:05.499168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:05.508014 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a60bf5c4-52c4-490f-8037-1fedf7a0c1a2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.228840 Jul 26 15:38:05.509187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 192/379] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:05 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:05.705513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:05.706631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:05.726556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.737060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.738187 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.738803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.761095 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:05.762508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:05.775408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.778327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:05.780997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:05.783155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.031482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.043091 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aa89555b-3ae5-44df-86bb-9f28b792ab3c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.287486 Jul 26 15:38:06.056700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 193/380] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:05 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:06.056700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:06.056700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:06.063991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.065016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.066067 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.066741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.255747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.267896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.274036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.275390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-753c18b1-dce8-408b-b03e-d38a052e41ed tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.575744 Jul 26 15:38:06.275979 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 188/381] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:05 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:06.290635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:06.323383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:06.333279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.334025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.334991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.338709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.403170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.412905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-573d65ee-fa4b-4d79-8a47-0e3d6b4d6b46 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1375 microversion: 2.1 time: 0.366367 Jul 26 15:38:06.413854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 194/382] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:06 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1375 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:06.536350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:06.537314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:06.548755 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.552142 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.554024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:06.564221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:06.755824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.765918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fa03d2b4-2c4f-4197-b365-4a7ef4de9fc5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.239384 Jul 26 15:38:06.766830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 195/383] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:06 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:06.834860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:06.842262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bcaf405e-f6cc-42e5-8c1a-7c6ee4020821 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.560533 Jul 26 15:38:06.852103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 189/384] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:06 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:07.068774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:07.071598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:07.080717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.081820 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.083148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.083804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.271865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:07.283592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-702d9271-52d5-417a-a6f2-534ceea74328 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.222331 Jul 26 15:38:07.283907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 196/385] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:07 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:07.301766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:07.302740 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:07.316588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:07.317490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.322964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.324795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.326461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.439855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:07.440819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:07.470351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.471005 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.472156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.472858 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.894161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:07.897429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:07.906223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2dbb472b-1236-4c3d-84c3-4bcfdd6b5733 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1568 microversion: 2.1 time: 0.472402 Jul 26 15:38:07.920859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:07.920859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:07.920859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-37c57c08-f789-4f2b-8aac-c284af87291d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.622551 Jul 26 15:38:07.923555 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 197/386] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:07 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1568 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:07.927437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 190/387] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:07 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:07.936204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:07.936851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:07.939549 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:07.940448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:07.946309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.946762 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.947547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.954009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.957173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.959002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:07.962397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:07.971397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.227827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:08.239604 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8782b7b1-5ff8-4fd6-9e40-610bedafa3b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.310763 Jul 26 15:38:08.250323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 191/388] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:07 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:08.260279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:08.260942 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:08.276624 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.277164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.278139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.278589 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.384590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:08.396532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5afec6eb-99e2-4cd6-a9ec-fe9a59947de7 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.469820 Jul 26 15:38:08.399185 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 198/389] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:07 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:08.414141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:08.415396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:08.429478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.436635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7026ebef-4a69-473f-be68-5c75821bcf39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176684 Jul 26 15:38:08.436882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.436882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.436882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.437169 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 192/390] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:38:08 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:08.944773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:08.945696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:08.978056 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.981425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:08.982925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:08.990643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:09.066554 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:09.257922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.272165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-31385bb2-4dfb-4ee4-ab32-f4c7b846829f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.871853 Jul 26 15:38:09.283394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 199/391] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:08 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:09.288724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:09.289434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:09.307034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:09.308333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:09.309386 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:09.310609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:09.451347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.488962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.491286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.523860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-19e24bf5-232f-4e7e-97ad-7e3f4d75bb47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.583438 Jul 26 15:38:09.525975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 193/392] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:08 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:09.577779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:09.578727 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:09.591175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:09.592708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:09.594688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:09.595154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:09.763034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.773587 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7e18ca76-5eb6-42fc-bbaa-88419bed9c95 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.488767 Jul 26 15:38:09.777003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 200/393] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:09 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:09.792857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:09.801642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b1321ff6-8895-4e6c-8fcc-a0b4367258ed tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.273858 Jul 26 15:38:09.802233 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 194/394] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:09 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:10.304377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:10.304966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:10.323932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.327173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.327173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.327173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.554853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:10.556155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:10.564141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.568544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.568544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.568544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.582557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:10.609638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-09b92756-df49-4191-88e0-01e6a41fc6a5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.309485 Jul 26 15:38:10.610896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 201/395] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:10 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:10.802100 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:10.803164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:10.825411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:10.825681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.825681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.825681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.827232 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.832704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:10.834624 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:10.836424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-12ffc118-9991-4889-b7c1-8747d11d58d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.285509 Jul 26 15:38:10.837628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 195/396] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:10 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:10.843761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:10.846925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:10.858578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.859956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:10.861296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:10.862132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:11.128253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:11.141612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f53475ec-93c1-4d80-9ca0-2caf65c3aceb tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.302541 Jul 26 15:38:11.143288 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 196/397] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:10 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:11.149941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-c6584195-cd29-4cb8-92b1-fc7d69bfa584 req-820d4244-91ab-4820-b3e8-6171a13ab12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065d4125-a5c9-42f0-aaf7-4c8b7250c221", "name": "network-vif-plugged", "status": "completed", "tag": "1677bd44-b76c-4604-b1ac-43c7dded5da3"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:11.162035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-c6584195-cd29-4cb8-92b1-fc7d69bfa584 req-820d4244-91ab-4820-b3e8-6171a13ab12a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:11.163317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-c6584195-cd29-4cb8-92b1-fc7d69bfa584 req-820d4244-91ab-4820-b3e8-6171a13ab12a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:11.201428 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-c6584195-cd29-4cb8-92b1-fc7d69bfa584 req-820d4244-91ab-4820-b3e8-6171a13ab12a service nova] Creating event network-vif-plugged:1677bd44-b76c-4604-b1ac-43c7dded5da3 for instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 on hv-cinder-85103 Jul 26 15:38:11.214885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-c6584195-cd29-4cb8-92b1-fc7d69bfa584 req-820d4244-91ab-4820-b3e8-6171a13ab12a service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069839 Jul 26 15:38:11.219432 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 197/398] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:11.665645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:11.673408 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:11.686751 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:11.694775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:11.694775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:11.694775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:11.695313 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:11.703752 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7003f21f-8eb7-43d9-93d0-dd2e039531cd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.907735 Jul 26 15:38:11.725000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 202/399] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:10 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:11.866628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:11.869089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:11.890570 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:11.891640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:11.895172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:11.901053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.188752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:12.200011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9e653379-add9-47cd-84d3-40e6a894c179 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 0.572716 Jul 26 15:38:12.201609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 198/400] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:11 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:12.207688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:12.208601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:12.221178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:12.223554 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.232407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:12.233891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.510154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:12.510154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-70cb2552-89d9-4bf3-89f1-bf1d829a9cb5 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.300714 Jul 26 15:38:12.510154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 199/401] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:12 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:12.642641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:12.646842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:12.665842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:12.667734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:12.675750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e4b192cc-2750-40a9-8872-bfe4cde86e97 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.813934 Jul 26 15:38:12.677664 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 203/402] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:11 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:12.730405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:12.735055 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:12.750075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:12.751699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.751699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:12.752448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.876430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-4bbbc603-84d6-4c03-bc89-ac387f1c3060 req-6c18a448-a65b-4014-ab47-65ddf95266f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:12.913080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4bbbc603-84d6-4c03-bc89-ac387f1c3060 req-6c18a448-a65b-4014-ab47-65ddf95266f8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:12.913873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4bbbc603-84d6-4c03-bc89-ac387f1c3060 req-6c18a448-a65b-4014-ab47-65ddf95266f8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:12.955417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-4bbbc603-84d6-4c03-bc89-ac387f1c3060 req-6c18a448-a65b-4014-ab47-65ddf95266f8 service nova] Creating event network-changed:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:38:12.979598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-4bbbc603-84d6-4c03-bc89-ac387f1c3060 req-6c18a448-a65b-4014-ab47-65ddf95266f8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107476 Jul 26 15:38:12.980553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 204/403] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:38:12.995695 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:13.008939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-97468884-5aa7-4bcf-a7e7-9943e7d65c1e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.283341 Jul 26 15:38:13.023930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 200/404] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:12 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:13.230996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:13.232529 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:13.251623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:13.252801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:13.257984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:13.259040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:13.539333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:13.542366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:13.579710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:13.597583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:13.598607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:13.599068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.091610 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.103591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-279f8267-6e6a-4ba0-aa23-5bb082f78f57 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.576500 Jul 26 15:38:14.111515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 201/405] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:13 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:14.140104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:14.140104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:14.156060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.156919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.157746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.158189 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.228209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.251035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6e5f7c32-148f-4430-9d04-aac0247ffc20 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1371 microversion: 2.1 time: 1.023814 Jul 26 15:38:14.251684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 205/406] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:13 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1371 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:14.263931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:14.268528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:14.291865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.294901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.297662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.299628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.603099 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.616306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-775a6fb3-9a35-4da3-8496-b722097d307f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.362667 Jul 26 15:38:14.619542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 206/407] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:14 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:14.799513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.838494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.842890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:14.845101 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-89f916e2-8e69-476f-8921-94d55653acaa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.723175 Jul 26 15:38:14.846228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 202/408] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:14 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:15.127622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:15.128305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.140087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.141428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.143235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.143773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.275047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:15.277283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.301771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.301771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.301771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.303149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.507306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:15.520769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-58ae9f42-d161-4064-b209-2b7215469e77 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.397114 Jul 26 15:38:15.525995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 207/409] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:15 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:15.626190 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:15.635371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2b4f63a3-1727-4d1e-9f39-d2c832b079f6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1558 microversion: 2.1 time: 0.364863 Jul 26 15:38:15.635371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 203/410] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:15 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1558 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:15.643172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:15.643846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.658966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.663747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:15.663747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.663981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.664285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.665922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.671779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.672538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.674839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.675486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.877571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c400715c-27b2-40d2-8b6a-284746a9eb42 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221889 Jul 26 15:38:15.879607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 204/411] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:38:15 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:15.884932 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:15.886323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.900730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.902944 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:15.907339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:15.909731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:16.225413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:16.237341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-17d137ca-6fc3-4fd1-8c5c-f2cfba0f1256 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.598215 Jul 26 15:38:16.237943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 208/412] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:15 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:16.330154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:16.339028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:16.343325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:16.347118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f1884b88-dae7-4835-b93d-93581b221e6b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.466465 Jul 26 15:38:16.351043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 205/413] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:15 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:16.564815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:16.564815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:16.580335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:16.581395 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:16.585692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:16.595925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.092872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.105219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b12833b-da62-4a9a-b02c-cf2203539b66 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.547283 Jul 26 15:38:17.106965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 209/414] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:16 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:17.260221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:17.261103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:17.280352 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.281614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.282429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.282879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.379412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:17.379952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:17.386805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.387244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.389663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.390101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.516992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.525907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-145f79fb-b251-44ff-b9fa-aadb6c9a79f3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.270137 Jul 26 15:38:17.526496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 206/415] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:17 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:17.538572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.547239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.548802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.549965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0758146c-cb76-4db7-9114-61d94f8eb0af tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.175410 Jul 26 15:38:17.553911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 210/416] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:17 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:18.128943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:18.130996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-be706895-6850-43cd-850d-0f20e496d80e req-dcbd7573-e36f-4393-9d9a-76dd1fed9554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12001b8e-4e0a-434b-a0a1-da91ba40d1ab", "name": "network-vif-plugged", "status": "completed", "tag": "1d2e29ba-8a5a-42e4-b7a5-95b96948355e"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:18.132006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:18.148017 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.156759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.156759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.156759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.160922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-be706895-6850-43cd-850d-0f20e496d80e req-dcbd7573-e36f-4393-9d9a-76dd1fed9554 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.161626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-be706895-6850-43cd-850d-0f20e496d80e req-dcbd7573-e36f-4393-9d9a-76dd1fed9554 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.187027 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-be706895-6850-43cd-850d-0f20e496d80e req-dcbd7573-e36f-4393-9d9a-76dd1fed9554 service nova] Creating event network-vif-plugged:1d2e29ba-8a5a-42e4-b7a5-95b96948355e for instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab on hv-cinder-85103 Jul 26 15:38:18.205699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-be706895-6850-43cd-850d-0f20e496d80e req-dcbd7573-e36f-4393-9d9a-76dd1fed9554 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086179 Jul 26 15:38:18.206960 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 207/417] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:18.554003 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:18.554705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:18.573107 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.577817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.578948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.579782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.786278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:18.795241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e17387a3-4617-482a-911b-dcadeb3ab14f tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.670898 Jul 26 15:38:18.795833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 211/418] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:18 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:18.817430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:18.818248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:18.826162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.826933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.827877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.828325 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:19.138218 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:19.151545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:19.161009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:19.168448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b31a3a10-51b8-478a-a66f-19ea4a189176 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.371518 Jul 26 15:38:19.170472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 212/419] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:18 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:19.215285 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:19.244543 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e00e5f44-803a-4fad-8ea1-77bea9b00208 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.696742 Jul 26 15:38:19.250576 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 208/420] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:18 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:19.315874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-a5a1dc78-f9f5-43a5-b045-f173464b7296 req-5520f2f6-5209-45f1-a3d8-14161bc4da43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065d4125-a5c9-42f0-aaf7-4c8b7250c221", "tag": "1677bd44-b76c-4604-b1ac-43c7dded5da3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:19.331289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-a5a1dc78-f9f5-43a5-b045-f173464b7296 req-5520f2f6-5209-45f1-a3d8-14161bc4da43 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:19.332031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-a5a1dc78-f9f5-43a5-b045-f173464b7296 req-5520f2f6-5209-45f1-a3d8-14161bc4da43 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:19.360823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-a5a1dc78-f9f5-43a5-b045-f173464b7296 req-5520f2f6-5209-45f1-a3d8-14161bc4da43 service nova] Creating event network-changed:1677bd44-b76c-4604-b1ac-43c7dded5da3 for instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 on hv-cinder-85103 Jul 26 15:38:19.372193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-a5a1dc78-f9f5-43a5-b045-f173464b7296 req-5520f2f6-5209-45f1-a3d8-14161bc4da43 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065617 Jul 26 15:38:19.374638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 213/421] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 15:38:19.817226 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:19.817987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:19.843611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:19.851389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:19.854496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:19.855095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.156381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:20.172373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1306ad31-89ef-4b7d-88c6-9803d3676389 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.359237 Jul 26 15:38:20.185699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 209/422] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:19 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:20.205840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:20.205840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:20.218855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.224814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.224814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.224814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.278795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:20.279421 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:20.301145 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.301761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.303212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.303660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.715474 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:20.726957 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:20.732151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d243a05f-985d-4d2f-afeb-e74e96177ebf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.450431 Jul 26 15:38:20.747868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 210/423] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:20 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:20.763747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:20.770577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:20.772018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2770286a-2c42-4a5a-b0b0-7ae8e577d58b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.574312 Jul 26 15:38:20.772612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 214/424] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:20 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:21.195260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:21.197489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:21.210130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.212811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.213837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.216782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.755923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:21.757180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:21.770539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.773066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.782205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.782205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.846886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:21.849897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:21.866623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1916e41a-edf3-4660-a258-81c956c0ef45 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1317 microversion: 2.1 time: 0.675068 Jul 26 15:38:21.869834 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 211/425] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:21 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:21.879466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:21.883232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:21.897935 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.898649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.899488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:21.899923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:22.249664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:22.267363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:22.276143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:22.277840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f3c1adc8-22ef-43cd-8d0e-7164175067f2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.406866 Jul 26 15:38:22.281693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 212/426] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:21 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:22.478340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:22.494769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ac66b0c-516c-4353-9e79-7b3a2b654f21 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1726 microversion: 2.1 time: 0.742730 Jul 26 15:38:22.496263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 215/427] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:21 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1726 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:22.894789 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:22.899787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:22.906643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:22.922345 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:22.930798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:22.931318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.312824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:23.314053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:23.328052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.331315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.333707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.335888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.345295 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:23.368808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-47c7d31d-25a3-4730-9b28-b86e95e4e3bd tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1501 microversion: 2.1 time: 0.477683 Jul 26 15:38:23.381360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 213/428] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:22 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:23.518035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:23.518759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:23.525490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.526222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.527168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.528335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.157581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.165774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0e17f73f-56a1-419b-8ed3-ba5254403328 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1703 microversion: 2.1 time: 0.651199 Jul 26 15:38:24.177513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 214/429] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:23 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1703 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:24.193276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-092df99e-c133-40d2-b4fa-5860255d7f5e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:24.208326 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-092df99e-c133-40d2-b4fa-5860255d7f5e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:24.215250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-092df99e-c133-40d2-b4fa-5860255d7f5e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.238232 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.245650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.256847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.258288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9d5b0177-e2d4-48b1-9916-b053b45d62c2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.950924 Jul 26 15:38:24.258849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 216/430] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:23 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:24.391260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-092df99e-c133-40d2-b4fa-5860255d7f5e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Going to try to start instance {{(pid=124842) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:38:25.017074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-092df99e-c133-40d2-b4fa-5860255d7f5e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action" status: 202 len: 0 microversion: 2.1 time: 0.827768 Jul 26 15:38:25.025632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 215/431] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:38:24 2022] POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:38:25.036872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:25.037782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:25.072841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.073429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.074276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.075285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.114408 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:25.115019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:25.135693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.136198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.137059 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.137530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.239207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:38:25.638574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:25.654594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d8b3c826-6a53-4a26-94c1-0bc8d258aecf tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1712 microversion: 2.1 time: 0.623667 Jul 26 15:38:25.664765 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 217/432] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:25 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1712 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:25.673272 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c8df81d3-2dab-4f53-b5ff-7603c1bea78c tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "DELETE /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 204 len: 0 microversion: 2.1 time: 0.566185 Jul 26 15:38:25.674743 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 216/433] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:38:25 2022] DELETE /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:38:25.685203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:25.686548 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:25.692163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:25.707753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:25.713870 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.721096 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.722316 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.725020 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.732502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.745236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:25.752239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:25.752239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:26.149032 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:26.162376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:26.174774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:26.176539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:26.179290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-22d1d980-33e0-4036-a966-929b39713760 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.513154 Jul 26 15:38:26.182809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 218/434] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:25 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:26.223257 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a2780e06-4536-442c-ac2c-1151411b3f32 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1507 microversion: 2.1 time: 0.543114 Jul 26 15:38:26.249087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 217/435] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:25 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:26.694804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:26.695641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:26.703966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:26.706824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:26.709704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:26.712506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:26.978172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:26.991642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-85cfb5a8-221d-4f0a-8eb0-9396541a304c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1712 microversion: 2.1 time: 0.301517 Jul 26 15:38:26.992667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 219/436] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:26 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1712 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:27.217461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:27.219772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:27.242017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:27.242465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:27.254338 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:27.254952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:27.267944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:27.268803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:27.269753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:27.277257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:27.278296 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:27.278893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:27.606977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:27.616273 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-df844a72-35fe-49a3-b833-daebb3c0e2e2 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1507 microversion: 2.1 time: 0.366573 Jul 26 15:38:27.628242 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 220/437] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:27 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:27.844049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:27.852640 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:27.872611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:27.881879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-991852e7-5f78-43e5-b2ce-8c59da47b207 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1743 microversion: 2.20 time: 0.675932 Jul 26 15:38:27.884854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 218/438] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:27 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1743 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:28.020023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:28.020748 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:28.036597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:28.037065 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:28.038640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:28.039175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:28.648006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:28.648396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:28.665924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:28.665924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:28.666558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:28.667002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:29.040590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:29.043602 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:29.059759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9577d1e3-7070-41c0-a60e-12549466b10f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1712 microversion: 2.1 time: 1.045937 Jul 26 15:38:29.063991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 221/439] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:28 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1712 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:29.070623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:29.071497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:29.086707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:29.086707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:29.086707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:29.086707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:29.195248 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:29.208304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8ae46d8d-868d-4b4a-af4e-9bf6140df75b tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1507 microversion: 2.1 time: 0.560549 Jul 26 15:38:29.209351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 219/440] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:28 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:29.778425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:29.789953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:29.791522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:29.806905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a77ea068-e0dd-4b53-bc4d-0eb5e87dced2 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1725 microversion: 2.20 time: 0.727462 Jul 26 15:38:29.814009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 222/441] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:29 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1725 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:29.976278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-11f8c17e-05a7-4688-8240-0742cc95519f req-e67064c5-4679-42c8-9800-5b096b4cbf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12001b8e-4e0a-434b-a0a1-da91ba40d1ab", "name": "network-vif-deleted", "tag": "1d2e29ba-8a5a-42e4-b7a5-95b96948355e"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:29.992770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-11f8c17e-05a7-4688-8240-0742cc95519f req-e67064c5-4679-42c8-9800-5b096b4cbf74 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.001969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-11f8c17e-05a7-4688-8240-0742cc95519f req-e67064c5-4679-42c8-9800-5b096b4cbf74 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.040327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-11f8c17e-05a7-4688-8240-0742cc95519f req-e67064c5-4679-42c8-9800-5b096b4cbf74 service nova] Creating event network-vif-deleted:1d2e29ba-8a5a-42e4-b7a5-95b96948355e for instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab on hv-cinder-85103 Jul 26 15:38:30.054411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-11f8c17e-05a7-4688-8240-0742cc95519f req-e67064c5-4679-42c8-9800-5b096b4cbf74 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084983 Jul 26 15:38:30.055537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 220/442] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:30.086484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:30.087263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:30.096525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.098656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.100381 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.101981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.235943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:30.252750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:30.265491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.266197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.271044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.271044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.587494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8e0d314c074eaa91f6b16c6777cf1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb5cc7e509e84773bec86203332e38af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:30.597783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-763803c6-741a-4f79-943a-10614be5e17e tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 200 len: 1302 microversion: 2.1 time: 0.367879 Jul 26 15:38:30.610181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 221/443] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:30 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 1302 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:30.647705 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:30.697699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8ccf862c-1e9a-45c4-be7d-fdf14b333caa tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1716 microversion: 2.1 time: 0.614950 Jul 26 15:38:30.708897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 223/444] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:30 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1716 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:30.845491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:30.846492 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:30.854151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.854721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:30.856400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:30.857154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:31.297051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:31.311614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:31.314173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:31.322857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ffdcaa22-8335-461c-a11c-74e9120f3ade tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1725 microversion: 2.20 time: 0.485799 Jul 26 15:38:31.345976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 222/445] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:30 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1725 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:31.585935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-26ee44a6-c62f-4eb3-b2c3-eab2690c9057 req-27401adb-e4a8-4005-90e0-7a0f621b0041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "name": "network-vif-unplugged", "status": "completed", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:31.594540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=82 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:31.602416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-26ee44a6-c62f-4eb3-b2c3-eab2690c9057 req-27401adb-e4a8-4005-90e0-7a0f621b0041 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:31.606899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-26ee44a6-c62f-4eb3-b2c3-eab2690c9057 req-27401adb-e4a8-4005-90e0-7a0f621b0041 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:31.616221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-26ee44a6-c62f-4eb3-b2c3-eab2690c9057 req-27401adb-e4a8-4005-90e0-7a0f621b0041 service nova] Creating event network-vif-unplugged:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:38:31.622262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-26ee44a6-c62f-4eb3-b2c3-eab2690c9057 req-27401adb-e4a8-4005-90e0-7a0f621b0041 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041053 Jul 26 15:38:31.623110 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 224/446] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:31.631429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:31.632036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] [instance: 12001b8e-4e0a-434b-a0a1-da91ba40d1ab] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:31.641618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:31.641618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:31.641618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:31.642015 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:31.658752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] HTTP exception thrown: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Request method failure captured: Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab HTTP/1.1 Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AooWNCXzuG43d7y3aeYR44L41SN1u4r3RlvFOxOQ3BKAF7RR_0l_ArZXdXHZi8ow2ZfPpYvXxmf8YKQuMVmE21ELowzFo_coNzM4xCzPJ6glaXyT6r8rYjEq07Ap_RnxlAYWdX1wZ7iU3FnsvtOL29EHWmZh1ifzP7mKiIaSIRXt-Q Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: eb5cc7e509e84773bec86203332e38af Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesActionsTest-943674698 Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:38:31.660417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/eb5cc7e509e84773bec86203332e38af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_eb5cc7e509e84773bec86203332e38af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/eb5cc7e509e84773bec86203332e38af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/eb5cc7e509e84773bec86203332e38af"}]}] Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesActionsTest-943674698 Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: eb5cc7e509e84773bec86203332e38af Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesActionsTest-943674698 Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesActionsTest-943674698-project Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 8c8e0d314c074eaa91f6b16c6777cf1e Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesActionsTest-943674698-project Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. Jul 26 15:38:31.661707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '12001b8e-4e0a-434b-a0a1-da91ba40d1ab'} Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:38:31.662438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. Jul 26 15:38:31.663662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:38:31.668891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] Returning 404 to user: Instance 12001b8e-4e0a-434b-a0a1-da91ba40d1ab could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:38:31.668891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a424a319-26fe-425e-9e1e-7a5e1da44713 tempest-VolumesActionsTest-943674698 tempest-VolumesActionsTest-943674698-project] 10.222.0.128 "GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab" status: 404 len: 111 microversion: 2.1 time: 0.035157 Jul 26 15:38:31.668891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 223/447] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:31 2022] GET /compute/v2.1/servers/12001b8e-4e0a-434b-a0a1-da91ba40d1ab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:38:32.369599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:32.370366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:32.407345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:32.407803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:32.430305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:32.434662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:32.850667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:32.864270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:32.879013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:32.882640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a1fd99a9-b77b-4ccd-bd07-b83a2c6c263c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1725 microversion: 2.20 time: 0.535527 Jul 26 15:38:32.885296 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 225/448] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:32 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1725 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:33.913379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:33.914003 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:33.928869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:33.934501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:33.939090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:33.939819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:34.377496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:34.391655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:34.394130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:34.396677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fea8a505-4162-4b6f-af1d-5b3c563bb046 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1725 microversion: 2.20 time: 0.486688 Jul 26 15:38:34.398318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 224/449] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:33 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1725 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:35.422227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:35.422844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:35.429516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:35.430227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:35.431212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:35.431833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:35.619642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:35.644818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:35.647026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:35.648551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a11c8f34-2e55-4ff8-b2f1-f295f4ed375e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1728 microversion: 2.20 time: 0.231451 Jul 26 15:38:35.649620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 226/450] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:35 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:35.692558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "211707e0-b324-496f-a821-e7d5d1cfbc50"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:35.695118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:35.711808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:35.712645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:35.721396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:35.722099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:36.522861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:37.209804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d6b994c2-131e-4fed-b8bd-2f552fc38cb0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.524472 Jul 26 15:38:37.212842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 225/451] 10.222.0.128 () {62 vars in 1369 bytes} [Tue Jul 26 15:38:35 2022] POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments => generated 188 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:38:37.484551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:37.485127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:37.521701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:37.522273 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:37.522991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:37.523482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:38.006749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-20936077-106a-42ab-b68c-e881e0bf9166 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/action" status: 202 len: 0 microversion: 2.20 time: 0.527840 Jul 26 15:38:38.010581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 227/452] 10.222.0.128 () {62 vars in 1324 bytes} [Tue Jul 26 15:38:37 2022] POST /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:38:38.017082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:38.017839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:38.043844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:38.043844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:38.043844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:38.043844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:38.678134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:38.697205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:38.699633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:38.702019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f098d869-321f-40a9-ac14-835457de4caf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1814 microversion: 2.20 time: 0.689449 Jul 26 15:38:38.717443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 226/453] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:38 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1814 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:39.747174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:39.748096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:39.767070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-289155317", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:39.767655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:39.768049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:39.771289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:39.771931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:40.151101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:40.168905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:40.176399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:40.177996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4e314e5c-ffd6-4528-83b3-b706032270f1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.436504 Jul 26 15:38:40.179984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 228/454] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:39 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:41.206462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:41.207760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:41.218420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:41.220550 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:41.226342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:41.227006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:41.514719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:41.524000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:41.541146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:41.542824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4a584406-3e2f-4e5d-8070-866d20ce6d26 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.340587 Jul 26 15:38:41.543878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 229/455] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:41 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:42.597987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:42.599529 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:42.613762 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:42.614613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:42.615670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:42.616337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:42.898051 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:42.913935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:42.916601 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:42.921543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ca8039bc-740e-4fd5-ab3e-7d7f4eeef5eb tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.327528 Jul 26 15:38:42.949971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 230/456] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:42 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:43.963445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:43.965532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:43.971778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:43.972171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:43.973025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:43.973466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:44.140150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:44.150580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:44.153058 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:44.154740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-afc08371-f265-4a60-aeca-1929ab5e4c09 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.204154 Jul 26 15:38:44.155871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 231/457] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:43 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:45.181569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:45.182217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:45.217717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:45.218179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:45.225626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:45.226353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:45.571306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:45.593278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:45.594971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:45.596229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7063d979-7883-44fc-938c-4b68abb67a46 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.418582 Jul 26 15:38:45.608784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 232/458] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:45 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:45.768697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c7434ea0-2230-4332-9cac-ce27abf902c5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Action: 'create', calling method: .version_select at 0x7f346ac0d820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1871278468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJvBm6xchimgQcSgS24+FATeESPPYFBfzS/qcEb43uvXugExNe3rSGgE+1CsWlb1WDUQi2xDZJZU7JfCkiH+QhFSbBI0G9/x349jqUs8Js2t5fWkuzEibYBRnSheIW1Ww=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:45.794249 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-c7434ea0-2230-4332-9cac-ce27abf902c5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for project 3e5dd905492343709b710fabd8a3d24f. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:45.799641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-c7434ea0-2230-4332-9cac-ce27abf902c5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for user 39f0a10b47b84bd1bd8ff8177362d791 and project 3e5dd905492343709b710fabd8a3d24f. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:45.903156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c7434ea0-2230-4332-9cac-ce27abf902c5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.295573 Jul 26 15:38:45.904032 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 233/459] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:38:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:46.626403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:46.627955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:46.649298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:46.650155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:46.652018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:46.652704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:47.017580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:47.030335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:47.031947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:47.033767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-da7c5aeb-4b6a-4e96-8206-d44042f905f5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.413827 Jul 26 15:38:47.049186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 234/460] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:46 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:48.065257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:48.065257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:48.082374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:48.082831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:48.083729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:48.084283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:48.414606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:48.429881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:48.431844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:48.434453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f1780b3-e6dd-4baf-a091-56af4ce3c205 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.376008 Jul 26 15:38:48.436292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 235/461] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:48 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:48.692481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:49.467336 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:49.467966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:49.479955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:49.480343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:49.481193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:49.481669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:49.788775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:49.839087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:49.852768 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:49.855556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:49.857112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ba9d77e9-2c7c-4a8f-b33b-e61efcc30c81 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.395666 Jul 26 15:38:49.858679 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 236/462] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:49 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:50.883090 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:50.883772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:50.896556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:50.897029 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:50.898050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:50.898793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:51.001896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] validate_networks() for None {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:38:51.243352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:51.256114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:51.262655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:51.268186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-792b646a-113a-4a50-81be-845e5a27a1e7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.388249 Jul 26 15:38:51.269751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 237/463] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:50 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:51.282387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6583de3a-9c39-4324-a164-c72aadb88c18 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'create', calling method: .version_select at 0x7f346ac76c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1273219420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtBbcSt+nVCCrv7DMPEn+fRfA1VINOn3BvaI9mYncYp0wh6iMp3VH4lyIjAhwEm5w+Qd4ZtGycJxAiXfq8GVbaNuRLF6UbM7DDGeyjma/y0j8uMxQGHHOwsVbaTihctkA=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:51.319860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-6583de3a-9c39-4324-a164-c72aadb88c18 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Getting quotas for project 7c892ef56ae9488089386d1a733ae3c0. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:51.344543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-6583de3a-9c39-4324-a164-c72aadb88c18 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Getting quotas for user 1f6f23b2e4134aa78862287f57323731 and project 7c892ef56ae9488089386d1a733ae3c0. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:51.518578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6583de3a-9c39-4324-a164-c72aadb88c18 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.243486 Jul 26 15:38:51.519451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 238/464] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:38:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:51.734561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:38:51.739106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:38:51.739106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:38:51.739106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:38:51.739106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:38:51.756525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:51.757172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:51.759142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:51.765196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:51.810905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Getting quotas for project d432a53d4fc44e8e9e557f7e3bca2c47. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:51.817937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Getting quotas for user c746449a143140fc87ee685c4fc5f3ea and project d432a53d4fc44e8e9e557f7e3bca2c47. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:51.834973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2140135986", "imageRef": "e6b4dbef-1c6b-443f-8d75-28727f68cdbb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1273219420", "networks": [{"uuid": "0835ecc4-c7ad-4c73-8803-8b011d8ed926"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:51.851454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:38:51.891696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:38:52.018803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] validate_networks() for [('0835ecc4-c7ad-4c73-8803-8b011d8ed926', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:38:52.170126 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e31cdb9d-3d45-4868-9201-d6087d30d25b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 12.406773 Jul 26 15:38:52.177120 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 227/465] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:38:39 2022] POST /compute/v2.1/servers => generated 382 bytes in 12414 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 15:38:52.190501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-291621ec-63e1-42ae-ac99-d18f47fc6bab tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:52.194399 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-291621ec-63e1-42ae-ac99-d18f47fc6bab tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:52.265969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-291621ec-63e1-42ae-ac99-d18f47fc6bab tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:52.277479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-291621ec-63e1-42ae-ac99-d18f47fc6bab tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1218 microversion: 2.1 time: 0.096136 Jul 26 15:38:52.291192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 228/466] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:52 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:52.306815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:52.316707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:52.338962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:52.348704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:52.349854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:52.351248 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:52.683909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:52.707072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:52.715331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:52.716788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eccdd78e-6796-4943-849e-c4c2b6a737b3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1754 microversion: 2.20 time: 0.423693 Jul 26 15:38:52.719334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 229/467] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:52 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1754 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:52.948583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:38:52.949019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:38:52.949504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:38:52.949920 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:38:52.950338 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:38:52.967507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:52.969132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:52.970367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:52.974957 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:53.011085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Getting quotas for project 7c892ef56ae9488089386d1a733ae3c0. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:53.021180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Getting quotas for user 1f6f23b2e4134aa78862287f57323731 and project 7c892ef56ae9488089386d1a733ae3c0. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:53.056418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:38:53.060276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6b4dbef-1c6b-443f-8d75-28727f68cdbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:38:53.277527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f69cc51-48eb-4ab2-8c92-83a504eb11d2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.445627 Jul 26 15:38:53.286825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 239/468] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:38:51 2022] POST /compute/v2.1/servers => generated 382 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 15:38:53.296580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fb07cca8-2561-49f0-9192-37cba7ee62a1 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:53.302412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fb07cca8-2561-49f0-9192-37cba7ee62a1 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:53.307988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7290800b-9181-47be-9b83-67638b3ad1fc tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:53.317685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7290800b-9181-47be-9b83-67638b3ad1fc tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:53.513009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7290800b-9181-47be-9b83-67638b3ad1fc tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:53.531862 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7290800b-9181-47be-9b83-67638b3ad1fc tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1218 microversion: 2.1 time: 0.228627 Jul 26 15:38:53.532878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fb07cca8-2561-49f0-9192-37cba7ee62a1 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:53.545876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fb07cca8-2561-49f0-9192-37cba7ee62a1 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1263 microversion: 2.1 time: 0.256660 Jul 26 15:38:53.549277 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 230/469] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:53 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:53.553983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 240/470] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:53 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:53.744216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:53.745703 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:53.761264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:53.761728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:53.762536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:53.762992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:53.975209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:53.990805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:53.991883 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:53.993131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4827d1c2-5c5a-46bd-9ee3-854e4444d4db tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1756 microversion: 2.20 time: 0.254773 Jul 26 15:38:53.994846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 231/471] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:53 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:54.596005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1981f8ff-bc6b-475b-8e39-c062b388df40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:54.596700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:54.597517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:54.598210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1981f8ff-bc6b-475b-8e39-c062b388df40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:54.604756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:54.605368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:54.606777 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:54.607460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:54.658191 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1981f8ff-bc6b-475b-8e39-c062b388df40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:54.665510 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1981f8ff-bc6b-475b-8e39-c062b388df40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1263 microversion: 2.1 time: 0.073833 Jul 26 15:38:54.666985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 232/472] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:54 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:54.688720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:54.691426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:54.697482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b1f7c0b0-0008-4d7c-b995-08538d4aece6 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1214 microversion: 2.1 time: 0.136798 Jul 26 15:38:54.698122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 241/473] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:54 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:55.023511 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:55.024363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:55.036200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.040825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.040825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.040825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.279759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:55.289273 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:55.290766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:55.292509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-549227d2-917e-4097-a4f9-ad12fef0c569 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1756 microversion: 2.20 time: 0.274508 Jul 26 15:38:55.294744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 233/474] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:55 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:55.689939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:55.691694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:55.700625 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.701457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.703034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.703751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.719700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:55.721392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:55.732206 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.734778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.737444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:55.738185 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:55.937965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:55.956875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-35b266d0-0f58-4afe-86b0-5f2ccbbf848d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1278 microversion: 2.1 time: 0.241209 Jul 26 15:38:55.965392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 234/475] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:55 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:56.115658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:56.141485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9a756b24-78c1-47de-b288-6b4fe78e3998 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1267 microversion: 2.1 time: 0.452368 Jul 26 15:38:56.143568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 242/476] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:55 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1267 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:56.321026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:56.321586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:56.330147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:56.330865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:56.332801 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:56.332801 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:56.507676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:56.529513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:56.531327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:56.532541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a41e093b-c346-44ca-b712-2fd0e5893b3e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.215492 Jul 26 15:38:56.533287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 235/477] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:56 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:56.615525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec2e11e9-8a1f-416a-a579-08bd266c67dc"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:56.619967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:56.637107 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:56.638332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:56.640730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:56.640730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:56.993555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:56.995412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:57.003477 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.005526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.005526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.006026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.205838 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:57.222864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b336dcad-b875-4c39-b08b-76651bf5c60a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1276 microversion: 2.1 time: 0.232938 Jul 26 15:38:57.225913 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 236/478] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:56 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:57.241711 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:57.242629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:57.254453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.254920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.255709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.257689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.377118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:57.393756 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-606db652-6ce1-4399-b571-9ffd1c77fa5c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1323 microversion: 2.1 time: 0.164414 Jul 26 15:38:57.395491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 237/479] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:57 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:57.561184 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:57.562543 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:57.580045 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.581890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.582844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:57.585123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:57.713235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bb26cc71-317f-42b5-9da2-bfd590ef1505 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.084092 Jul 26 15:38:57.716575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 243/480] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:38:56 2022] POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:58.031264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:58.048488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:58.050258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:58.062002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-578ea9c0-7b51-4117-b00f-94881a42a2a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.506726 Jul 26 15:38:58.082312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 238/481] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:57 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:38:58.249131 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:58.249849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:58.261814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:58.262256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:58.263052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:58.266279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:58.421487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:58.422197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:58.432975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:58.440946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:58.445632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:58.445632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:58.548913 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:58.566115 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:58.573722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-feae58a0-67f4-47a5-b9ee-1c2f9a195500 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.328294 Jul 26 15:38:58.577806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7f409d27-45cf-4af3-aba7-adedfd27b2e5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1321 microversion: 2.1 time: 0.160461 Jul 26 15:38:58.579132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 239/482] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:58 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:58.580630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 244/483] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:58 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:59.089882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:59.090684 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:59.098876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.099538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.100700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.101243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.162057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-75bb49ce-c7f0-426c-904f-f53c831b5275 req-28655e00-94d0-465c-8892-65ca3e2d94a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c08984-53ba-4b40-8291-6cab95a55413", "tag": "a3404dc2-300f-46d8-a1fd-9e8938434607"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:59.177070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-75bb49ce-c7f0-426c-904f-f53c831b5275 req-28655e00-94d0-465c-8892-65ca3e2d94a8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.182427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-75bb49ce-c7f0-426c-904f-f53c831b5275 req-28655e00-94d0-465c-8892-65ca3e2d94a8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.197553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-75bb49ce-c7f0-426c-904f-f53c831b5275 req-28655e00-94d0-465c-8892-65ca3e2d94a8 service nova] Creating event network-changed:a3404dc2-300f-46d8-a1fd-9e8938434607 for instance 93c08984-53ba-4b40-8291-6cab95a55413 on hv-cinder-85103 Jul 26 15:38:59.203438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-75bb49ce-c7f0-426c-904f-f53c831b5275 req-28655e00-94d0-465c-8892-65ca3e2d94a8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045232 Jul 26 15:38:59.204658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 245/484] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:38:59.421292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:59.438774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:59.466630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:59.473037 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1f66907a-84d3-4392-a5b1-6f5c5192f807 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.387793 Jul 26 15:38:59.474046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 240/485] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:38:59 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:38:59.605295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:59.606090 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:59.618656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:59.630717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.631168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.631919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:59.632167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.632685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.659853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.661115 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:59.662732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:59.663938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:00.046434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:00.063036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7e600fef-a515-4afe-806d-4317d9d3057e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.448852 Jul 26 15:39:00.081568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 241/486] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:59 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:00.184028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:00.236788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b7293230-12ba-4101-9250-24f0a881c121 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.641105 Jul 26 15:39:00.236788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 246/487] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:38:59 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:00.500450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:00.501102 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:00.511138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:00.511636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:00.512379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:00.515091 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:00.844815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-a6414d21-6bae-44d4-a10e-7bd54da444fa req-538bbba0-4f88-42ca-a702-e2f073b64716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:00.849029 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:00.865059 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:00.871822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:00.873381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-306db118-2374-4e3a-bc4d-0d9bd630dd5c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.377416 Jul 26 15:39:00.875351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 242/488] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:00 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:00.887456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-a6414d21-6bae-44d4-a10e-7bd54da444fa req-538bbba0-4f88-42ca-a702-e2f073b64716 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:00.890280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-a6414d21-6bae-44d4-a10e-7bd54da444fa req-538bbba0-4f88-42ca-a702-e2f073b64716 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:00.910759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-a6414d21-6bae-44d4-a10e-7bd54da444fa req-538bbba0-4f88-42ca-a702-e2f073b64716 service nova] Creating event network-changed:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:39:00.918104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-a6414d21-6bae-44d4-a10e-7bd54da444fa req-538bbba0-4f88-42ca-a702-e2f073b64716 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081232 Jul 26 15:39:00.919123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 247/489] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:01.089179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:01.089747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:01.096100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.096590 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:01.097366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.097808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:01.258738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:01.259724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:01.276342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.277504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:01.278804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.279831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:01.457965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:01.473967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-867427b8-d490-4435-ac55-e038133fc352 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.220482 Jul 26 15:39:01.474780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 248/490] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:01 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:01.656258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:01.664965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cd9c28f5-1c80-447d-aa5a-630a24eb210c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.579390 Jul 26 15:39:01.666709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 243/491] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:01 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:01.900645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:01.901580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:01.909942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.910403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:01.911394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:01.911802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:02.074228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:02.087019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:02.090395 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:02.092162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-17ba3884-ea7d-4940-9eb0-43e1563a67f0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.196795 Jul 26 15:39:02.108128 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 249/492] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:01 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:02.501777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:02.503818 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:02.507059 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:02.513353 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:02.513798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:02.514564 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:02.514996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:02.669674 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:02.679663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-329598ef-77ba-4bc7-a984-4c343b56d71a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.182975 Jul 26 15:39:02.688531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 244/493] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:02 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:02.698387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:02.699014 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:02.701718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:02.706828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:02.707562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:02.708713 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:02.709175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:02.858782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:02.868039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9ff73672-e9cb-45ac-84a3-8b42aa6197d3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.173612 Jul 26 15:39:02.869121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 250/494] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:02 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:03.115755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:03.116423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.125130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.125587 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.126422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.126930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.280865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:03.290079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:03.292629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:03.293877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-92429ec8-afb8-40d6-98b7-a05b094f0075 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.182396 Jul 26 15:39:03.294605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 245/495] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:03 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:03.654533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:03.655036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.658608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:03.659304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=16 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:03.665122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.665648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.666438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.666878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.696437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-54c2610c-2fb6-4bf1-8c77-0ee076d3379c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/ips" status: 200 len: 146 microversion: 2.1 time: 0.047178 Jul 26 15:39:03.698021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 251/496] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:39:03 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:03.703193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:03.704686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.711335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78033d37-231d-4871-b7d7-6169e88cafa4"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:03.712671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.713369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.714341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.714466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.714897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.721931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.722385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.723365 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.723810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.817824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/os-volume_attachments HTTP/1.1 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 74 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:39:03.819551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {"volumeAttachment": {"volumeId": "78033d37-231d-4871-b7d7-6169e88cafa4"}} Jul 26 15:39:03.821023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'server_id': '065d4125-a5c9-42f0-aaf7-4c8b7250c221', 'body': {'volumeAttachment': {'volumeId': '78033d37-231d-4871-b7d7-6169e88cafa4'}}} Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:03.822611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:03.824159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 400 to user: Invalid volume: volume 78033d37-231d-4871-b7d7-6169e88cafa4 is already attached to instances: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2df340a0-456a-40db-88af-2c2d710759e5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114876 Jul 26 15:39:03.830870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 252/497] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:39:03 2022] POST /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:39:03.832986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:03.833484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.841549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.842084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.843147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.843806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.874292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:39:03.935607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:03.944783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9e5bf64b-4ce9-42f9-8a4b-6ca95a6ab21e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.245950 Jul 26 15:39:03.948612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 246/498] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:03 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:03.951560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:03.952364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:03.970236 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.971548 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.972347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:03.972981 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:03.977532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:04.147681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:04.155693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1c003130-7eaa-4693-831f-f791ea6c1da3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.208972 Jul 26 15:39:04.156521 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 247/499] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:03 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:04.214420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6ce112b-fa1f-4e0c-993a-78b0ae8af01c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 204 len: 0 microversion: 2.1 time: 0.387307 Jul 26 15:39:04.215309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 253/500] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:39:03 2022] DELETE /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:39:04.225602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:04.226508 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:04.238666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.239647 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:04.240360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.241447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:04.321736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:04.323039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:04.331315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.332189 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:04.333258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.333773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:04.411066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:04.419884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-693867dd-0ab0-4d2f-bf95-3e717b4eaeb0 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1682 microversion: 2.1 time: 0.200366 Jul 26 15:39:04.420509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 248/501] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:04 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:04.519738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:04.532657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:04.534843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:04.535913 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-610d9988-9a30-4bee-a0d6-dab95913f992 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.219967 Jul 26 15:39:04.536925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 254/502] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:04 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:04.970000 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:04.970605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:04.972741 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=12 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:04.980022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.980793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:04.981519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:04.982018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.138222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.142150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b04e4d16-1712-45df-9818-ed405f2afcb8 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.176246 Jul 26 15:39:05.143822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 249/503] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:04 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:05.180316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:05.181149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:05.190237 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.190464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.191097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.191642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.419286 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.443028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:05.443782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:05.446314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-39a6a0a4-e808-4c35-91ee-f6f2dfec7a49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.270802 Jul 26 15:39:05.452597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 255/504] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:05 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:05.464009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.466311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.467692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.468535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.559599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:05.560212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:05.568395 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.568891 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.569674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:05.570114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:05.685259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.695162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-803786fc-d889-4c30-a700-dd7f49aee6db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1682 microversion: 2.1 time: 0.257330 Jul 26 15:39:05.695919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 250/505] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:05 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:05.764289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.773392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.775236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:05.776717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0750e023-c42d-451b-94a1-f528cf78f506 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.221418 Jul 26 15:39:05.780499 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 256/506] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:05 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:06.165193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:06.167198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:06.175356 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.176171 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.177366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.178058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.356277 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:06.367253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c65feb0d-e4bb-4c29-b96f-62b4ef89d573 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.203274 Jul 26 15:39:06.367253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 251/507] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:06 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:06.476992 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:06.477788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:06.489534 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.490324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.491391 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.491961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.497398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:06.641568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:06.649360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e72e8009-fee9-426c-80b8-62f65cc78b40 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.184647 Jul 26 15:39:06.649996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 257/508] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:06 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:06.728491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:06.728491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:06.729645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.730093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.730857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.731287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.800674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:06.801276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:06.808198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.808690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.809460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:06.809893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:06.889988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:06.901563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bc25a8c3-37b6-4f27-b8fe-8d76d8d712b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1682 microversion: 2.1 time: 0.183709 Jul 26 15:39:06.915948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 252/509] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:06 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:06.978347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:06.999025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:07.001067 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:07.002375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-667daf32-c8e0-447e-9ba0-3adb85413363 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.205812 Jul 26 15:39:07.004621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 258/510] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:06 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:07.405893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:07.405893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:07.410479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.410957 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.411762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.412200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.627847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:07.635897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f0e54127-1922-49d9-8571-26b874644d0b tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.239240 Jul 26 15:39:07.638508 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 253/511] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:07 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:07.671831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:07.674156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:07.678846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.685309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.685309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.685309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.875783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:07.887485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bf417bcc-3bcf-422c-bd02-a206dba489c5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.219540 Jul 26 15:39:07.897366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 259/512] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:07 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:07.923031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:07.925554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:07.926516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:07.932999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:07.934831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.935650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.936693 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.937668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.950087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.951337 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.952974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:07.953711 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:07.993809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'flavor' on Instance uuid e1394b46-b21c-48f5-96e4-881de63f22c2 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:08.019831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.030705 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d911a522-e429-4bcd-90c2-6b84b3751ab4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.111458 Jul 26 15:39:08.031312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 260/513] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:07 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:08.037629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:08.038738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:08.045159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.046006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.047007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.047608 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.234971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.245038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.246543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.247734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6d46c35f-b021-4983-b2cb-6340506ab095 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.215339 Jul 26 15:39:08.248574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 261/514] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:08 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:08.265234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-3b61c098-9fba-4f59-a47f-5cc53295b64f req-561ade68-5f98-4530-8b81-a97d4783ec52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065d4125-a5c9-42f0-aaf7-4c8b7250c221", "name": "network-vif-deleted", "tag": "1677bd44-b76c-4604-b1ac-43c7dded5da3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:08.277264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3b61c098-9fba-4f59-a47f-5cc53295b64f req-561ade68-5f98-4530-8b81-a97d4783ec52 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.277714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3b61c098-9fba-4f59-a47f-5cc53295b64f req-561ade68-5f98-4530-8b81-a97d4783ec52 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.289808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-3b61c098-9fba-4f59-a47f-5cc53295b64f req-561ade68-5f98-4530-8b81-a97d4783ec52 service nova] Creating event network-vif-deleted:1677bd44-b76c-4604-b1ac-43c7dded5da3 for instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 on hv-cinder-85103 Jul 26 15:39:08.295737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-3b61c098-9fba-4f59-a47f-5cc53295b64f req-561ade68-5f98-4530-8b81-a97d4783ec52 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039983 Jul 26 15:39:08.296687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 262/515] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:08.348796 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d3e52d1b-683b-47b4-8bed-1d64dab4f26d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/action" status: 200 len: 32 microversion: 2.1 time: 0.433888 Jul 26 15:39:08.349591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 254/516] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:39:07 2022] POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:39:08.360796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:08.361633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:08.368187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.369324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.370430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.370577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.515504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.525765 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b7a187e-fecc-4c0f-acdd-33a518e61967 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.168482 Jul 26 15:39:08.527769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 263/517] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:08 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:08.657175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:08.657882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:08.664970 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.665996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.666724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.667158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.878857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:08.891090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-823b84e7-0f9e-4fc2-b519-ff47d3f54515 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.237573 Jul 26 15:39:08.892636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 255/518] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:08 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:08.912014 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:08.913412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:08.924590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.928174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:08.928174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:08.928174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.052218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:09.053214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:09.070060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.070790 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.071832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.072483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.203347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.211123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eb8933e1-5328-4307-be81-02fb23d1f577 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.162854 Jul 26 15:39:09.211713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 256/519] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:09 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:09.218579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.227110 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-18519944-00c5-481c-a809-8f395a751f34 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.318800 Jul 26 15:39:09.229955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 264/520] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:08 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:09.271305 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:09.271921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:09.293925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.293925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.293925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.293925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.550511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:09.551125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:09.561610 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.561771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.562181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.563034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.563733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.589507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.591714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.601268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1f03db67-b4fe-4b42-b4a1-706935fb7c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.333709 Jul 26 15:39:09.605007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 257/521] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:09 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:09.877239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:09.889018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ee3438e1-7b69-43d8-986f-bdf55f362bbc tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.343776 Jul 26 15:39:09.891904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 265/522] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:09 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:09.915484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:09.916332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:09.935131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.935774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:09.936733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:09.937307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.139702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.152081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ca2ac56f-52fd-4699-b2ab-5ce5c71abc53 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.240704 Jul 26 15:39:10.153064 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 258/523] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:09 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:10.240496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:10.241150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:10.250034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.251123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.252094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.252712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.254074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:10.254693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:10.264701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.268752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.268752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.268752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.351457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.367990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07956159-fe39-47fb-b579-7371bd5a05ff tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.130502 Jul 26 15:39:10.370383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 266/524] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:10 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:10.529717 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.544357 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1919ef06-9e21-4718-a438-eba945ebbe78 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.296673 Jul 26 15:39:10.545179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 259/525] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:10 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:10.629137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:10.631150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:10.644591 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.645385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.646223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.648991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.822096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.831080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.832766 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:10.833873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-25ad5d61-4f9b-4119-9672-81f131f76e61 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.209220 Jul 26 15:39:10.834644 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 267/526] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:10 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:10.914958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:10.915943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:10.924113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.925017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:10.926081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:10.926628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.131438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:11.163591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c7ea029c-1d4b-45ef-9d8e-dae81d1840ab tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.252233 Jul 26 15:39:11.174633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 260/527] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:10 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:11.191231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:11.192119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:11.200132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.200638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.201439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.201878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.397439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:11.397439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:11.401058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.401866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.402866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.403618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.439250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:11.456102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8c06d9c6-2de5-453d-8b86-58d4e11cb23d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.283845 Jul 26 15:39:11.466818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 268/528] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:11 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:11.499224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:11.502961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:11.508009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-841b407b-ea3c-45fa-9743-bd317cb26925 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.121084 Jul 26 15:39:11.509146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 261/529] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:11 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:11.575740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:11.576887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:11.591935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.592918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.593972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.594836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.800614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:11.810171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28dd32f4-e8af-4795-8495-1b3278d184ee tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.240917 Jul 26 15:39:11.811501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 269/530] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:11 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:11.858581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:11.859713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:11.870607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.871392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:11.872656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:11.873326 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.011725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-3fc9a266-63d4-4f4a-813a-c903ed248ae9 req-bc40281d-6d3b-402a-a1d0-59ef595e2f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c08984-53ba-4b40-8291-6cab95a55413", "name": "network-vif-plugged", "status": "completed", "tag": "a3404dc2-300f-46d8-a1fd-9e8938434607"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:12.037607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3fc9a266-63d4-4f4a-813a-c903ed248ae9 req-bc40281d-6d3b-402a-a1d0-59ef595e2f1e service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.037607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3fc9a266-63d4-4f4a-813a-c903ed248ae9 req-bc40281d-6d3b-402a-a1d0-59ef595e2f1e service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.050653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-3fc9a266-63d4-4f4a-813a-c903ed248ae9 req-bc40281d-6d3b-402a-a1d0-59ef595e2f1e service nova] Creating event network-vif-plugged:a3404dc2-300f-46d8-a1fd-9e8938434607 for instance 93c08984-53ba-4b40-8291-6cab95a55413 on hv-cinder-85103 Jul 26 15:39:12.055894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-3fc9a266-63d4-4f4a-813a-c903ed248ae9 req-bc40281d-6d3b-402a-a1d0-59ef595e2f1e service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047632 Jul 26 15:39:12.057206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 270/531] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:12.075988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.092125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.097029 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.097986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-043866c6-1c1e-45da-b42f-da087167e280 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.243596 Jul 26 15:39:12.112761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 262/532] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:11 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:12.199248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:12.199969 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:12.206911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.207632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.208522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.209033 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.362531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.373482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6ccf5aed-be86-4af8-8aed-44928eeb1ee4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.179130 Jul 26 15:39:12.380568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 271/533] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:12 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:12.486311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:12.486941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:12.493412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.493864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.494630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.495063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.534614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:12.535443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:12.543262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.543918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.544733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.545222 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.709200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.724116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:12.731692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-16c5ae2a-fcfb-430a-9991-de829ed1fd3c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.245370 Jul 26 15:39:12.759141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 263/534] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:12 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:12.759375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d91e24d7-4a81-46ca-a019-e075aee5f755 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.213376 Jul 26 15:39:12.761229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 272/535] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:12 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:12.832807 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:12.833878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:12.842019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.843007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:12.843828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:12.844433 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.088558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.095867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ff8095ae-3b00-4679-8614-9cfde7767569 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.267010 Jul 26 15:39:13.096436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 264/536] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:12 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:13.123362 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:13.124175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:13.131462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.132256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.133335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.134521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.387080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.395570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:13.396186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:13.410789 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.410789 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.412491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.413164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.414096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.418702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.421880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8900e66c-9355-4feb-8de8-5c6192619769 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.302474 Jul 26 15:39:13.425261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 273/537] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:13 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:13.743433 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.753522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c5ee9f6e-eeeb-4884-b6f0-70f782643a01 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.361629 Jul 26 15:39:13.754749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 265/538] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:13 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:13.771408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:13.773087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:13.775134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:13.775943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:13.782562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.783004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.784192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.784678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.790281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.790861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.791798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:13.792245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:13.862327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:13.886022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-01692054-b964-4b7d-990e-f985a057efb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.116421 Jul 26 15:39:13.886638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 266/539] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:13 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:13.994884 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.004502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5c4b287d-9ea9-4151-8687-5139ab35acac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.238061 Jul 26 15:39:14.004502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 274/540] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:13 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:14.124436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:14.125563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:14.131743 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:14.134574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.135177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.136152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.136619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.347569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.366548 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fed88255-d41a-4ff3-ae85-985f7b24f03e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.251184 Jul 26 15:39:14.367151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 267/541] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:14 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:14.457718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:14.459518 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:14.472900 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.473260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.474080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.474521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.479609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:14.632937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.661409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.667474 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.670773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-60a6492c-a050-42ec-8a92-36cf32a0f036 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.220056 Jul 26 15:39:14.678291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 275/542] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:14 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:14.776488 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:14.777108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:14.784185 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.784734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.785768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.786370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.907626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:14.908245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:14.918472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.919697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.920799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:14.921795 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:14.962374 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:14.974223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-231843b5-8d04-4d1c-a3b5-a21c43c2e491 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.202698 Jul 26 15:39:14.975650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 268/543] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:14 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:15.014462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.027246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-171295d3-9787-4f65-9076-c38ac650dbb9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.122600 Jul 26 15:39:15.027246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 276/544] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:14 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:15.031452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:15.032134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:15.038743 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.039177 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.040066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.040525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.213435 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.222130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a1196659-1b30-4810-95f6-15ef2fac3dac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.194528 Jul 26 15:39:15.236922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 269/545] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:15 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:15.395430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:15.396546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:15.403986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.404439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.405247 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.405721 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.560759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.616666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-82f1ec37-233a-4788-9956-226ab731598e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.179045 Jul 26 15:39:15.616666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 277/546] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:15 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:15.711114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:15.712589 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:15.719627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.720011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.720826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:15.721266 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:15.916867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.916867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.917105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:15.917105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d3b5bf86-26c5-4854-a6d2-96df6c3180f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.214728 Jul 26 15:39:15.917890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 270/547] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:15 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:16.000012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:16.000606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:16.007105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.007806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.008851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.009456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.058445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:16.060621 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:16.066229 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.066872 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.067653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.068720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.161102 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:16.178003 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ca45bf45-e236-495c-a1ec-f27bd300d114 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.125083 Jul 26 15:39:16.179331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 271/548] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:16 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:16.229448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:16.237940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a6ed0f8-74d3-4c04-ad96-c9e90598566b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.241963 Jul 26 15:39:16.238528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 278/549] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:15 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:16.248830 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:16.249979 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:16.255918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.256293 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.257094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.263547 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.449699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:16.458605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2e26eedb-936d-4eaf-8e88-d455dfa438be tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.216041 Jul 26 15:39:16.471099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 272/550] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:16 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:16.629897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:16.630577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:16.640119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.641013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.642214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.642716 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.810320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:16.819160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a45d1e4-1496-4530-a591-79c56e1ae009 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.193825 Jul 26 15:39:16.819435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 279/551] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:16 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:16.931837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:16.932586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:16.939974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.940810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:16.941678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:16.942188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.147232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.157653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.159349 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.162920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-db600ac9-01da-4ea8-98c5-13e696de6a1a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.235136 Jul 26 15:39:17.164345 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 273/552] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:16 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:17.205636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:17.206236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:17.213803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.214257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.215070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.215507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.261755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:17.263813 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:17.271501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.272203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.277168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.277811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.324215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.332625 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ea46b574-7faa-4d5f-9917-3c2da11970db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.131825 Jul 26 15:39:17.340828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 280/553] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:17 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:17.472275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.479309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:17.482575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:17.494002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.497715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.503076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ee7e5e48-ac02-4111-accb-4d78823fc2d8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.240935 Jul 26 15:39:17.503282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.503282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.511070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 274/554] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:17 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:17.693854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:17.703258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ba0eaa1f-7247-46ab-8b71-59bba1113f9d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.228488 Jul 26 15:39:17.704982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 281/555] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:17 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:17.761973 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-372327971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1871278468", "security_groups": [{"name": "tempest-secgroup-smoke-807363734"}], "block_device_mapping_v2": [{"uuid": "40d1f030-f59c-4740-a667-b87a9ded9732", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80485f05-76b1-4fa2-b061-24e6bca76484"}]}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:17.839985 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:17.841462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:17.848991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.854316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.854316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:17.854316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:17.959032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] validate_networks() for [('80485f05-76b1-4fa2-b061-24e6bca76484', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:39:18.054962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.065557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1bb2b28a-1503-4267-8574-b659f05c9b3b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.230104 Jul 26 15:39:18.066422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 282/556] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:17 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:18.190012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:18.191254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:18.197745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.198353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.199145 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.199607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.396068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.407082 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.408680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.409927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ff746e7b-0f18-4d0b-b85d-9e24bde835c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.224347 Jul 26 15:39:18.410523 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 283/557] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:18 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:18.426815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:18.427512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:18.435830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.436444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.437484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.438190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.463835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:39:18.464438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:39:18.465108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:39:18.465350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:39:18.465754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:39:18.475292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.475655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.476434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.477032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.495962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:39:18.500896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for user 39f0a10b47b84bd1bd8ff8177362d791 and project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:39:18.515420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.523694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dd760ac6-2395-453b-b36b-b6a8630f27db tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1614 microversion: 2.1 time: 0.101068 Jul 26 15:39:18.525432 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 284/558] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:18 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:18.535219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:18.535940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:18.544312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.544793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.545596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.546055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.579395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:39:18.581718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d1f030-f59c-4740-a667-b87a9ded9732',volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:39:18.704179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.714651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6aae3502-ffdf-48f9-961c-e2ba2234397a tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.185432 Jul 26 15:39:18.715245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 285/559] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:18 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:18.735932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:18.736964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:18.757143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.758119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.759262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:18.760051 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:18.941724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:18.972948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ff98c4d3-e4a9-479f-81ed-60d7946c17bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.227360 Jul 26 15:39:18.972948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 286/560] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:18 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:19.089543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.090393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.093659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5b9174e6-bd2e-485c-8f76-05511636e304 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.330202 Jul 26 15:39:19.097117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.098618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 275/561] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:39:17 2022] POST /compute/v2.1/servers => generated 407 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:39:19.098806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.099530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.100105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.109943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a4d5419d-6b23-41de-bbc4-fa42672a7931 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.110953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a4d5419d-6b23-41de-bbc4-fa42672a7931 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.214311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a4d5419d-6b23-41de-bbc4-fa42672a7931 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.232591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a4d5419d-6b23-41de-bbc4-fa42672a7931 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1097 microversion: 2.1 time: 0.123463 Jul 26 15:39:19.236327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 276/562] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1097 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:19.343711 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.359164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-af59407d-a0ce-4570-9d62-0aa33f57137c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.273622 Jul 26 15:39:19.362028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 287/563] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:19.434899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.435748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.444990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.446219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.447396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.448339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.551976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.553038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.561129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.562694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.562694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.563528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.600444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.601000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.601533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:19.616844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.627817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.632119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.632119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8bac3b92-44aa-4d6c-bafa-4ad9abb2f994 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.202109 Jul 26 15:39:19.636711 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 277/564] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:19.654746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.667459 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-288f813f-8221-473f-a501-63e60ecadbb4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.119823 Jul 26 15:39:19.668229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 288/565] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:19.738089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.738696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.744881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.745334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.752391 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.752391 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.888814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:19.897274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b1515b88-aa91-4aa8-96c7-b0cadfd9ae4f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.163088 Jul 26 15:39:19.897903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 278/566] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:19.986132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:19.987098 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:19.993448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.993943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:19.994717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:19.995154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.215749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.232035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-29b2becc-a0a5-4542-bef6-e46d7f3d54bb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.249685 Jul 26 15:39:20.232825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 289/567] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:19 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:20.257451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1be41eb7-e064-4caf-b624-479e01bacf22 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:20.260719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1be41eb7-e064-4caf-b624-479e01bacf22 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:20.355261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1be41eb7-e064-4caf-b624-479e01bacf22 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.364928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1be41eb7-e064-4caf-b624-479e01bacf22 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1097 microversion: 2.1 time: 0.111651 Jul 26 15:39:20.381595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 279/568] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:20 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1097 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:20.387663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:20.388383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:20.411564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.412763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.415212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.416343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.616278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.638596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a69e2626-0328-46e7-954e-418eebc076a8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.254492 Jul 26 15:39:20.640847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 290/569] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:20 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:20.663798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:20.665278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:20.672028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.672771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.673718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.674477 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.695928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:20.697104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:20.705177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.705898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.707034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.707646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.732786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:20.768019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.768816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.769316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:20.824413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.840193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cd403d30-5e7c-4aeb-8ac0-8142652e19b3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.150675 Jul 26 15:39:20.842173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 291/570] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:20 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:20.890106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.921940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.925551 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:20.928081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f9257893-9ab6-4e4a-8fdc-304c403fc351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.268091 Jul 26 15:39:20.932902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:20.934460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:20.940963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 280/571] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:20 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:20.946465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.947959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:20.949600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:20.950794 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.149635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:21.160864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07192ae5-4327-4cca-8473-5631e86a0471 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.239952 Jul 26 15:39:21.173196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 292/572] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:20 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:21.255080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:21.256129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:21.268456 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.269434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.270890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.271691 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.283705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:21.392730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:21.393867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:21.415649 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.416565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.417688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.418237 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.472854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:21.484008 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-686d3c60-9766-4d7e-8272-cbef2aed1ce5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.231702 Jul 26 15:39:21.484008 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 281/573] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:21 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:21.571165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:21.572790 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-090b5008-551c-434a-8c4b-e02733467734 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1147 microversion: 2.1 time: 0.186364 Jul 26 15:39:21.580006 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 293/574] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:21 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1147 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:21.670620 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:21.671857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:21.692135 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.692954 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.693991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.694447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.863630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:21.869331 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:21.884066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.885070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.886153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.886828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.959098 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:21.969692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:21.970482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:21.971022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:22.034456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.045938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-caa936ab-94d2-4f81-a703-0760c3b605b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.186023 Jul 26 15:39:22.057510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 294/575] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:21 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:22.069463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:22.071202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:22.079504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.080512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.081510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.082903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.182581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.193012 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a035c62a-daec-4301-ba90-586d13d6fd2e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.526198 Jul 26 15:39:22.193615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 282/576] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:21 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:22.198531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:22.199222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:22.205906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.206644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.207474 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.208794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.253814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.284187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.286026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.287327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1b4cf734-0a9b-4bca-992f-a79b1d9ddf60 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.228196 Jul 26 15:39:22.288065 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 295/577] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:22 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:22.300592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:22.303064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:22.309015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.309796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.310668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.311160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.407278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'services' on Instance uuid 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:22.600257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.613757 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b50eb084-3ebb-43eb-a417-1af378b5a2ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.324233 Jul 26 15:39:22.615154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 296/578] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:22 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:22.637783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:22.641422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:22.658217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.658659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.659435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.659868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.752642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c57cfe98-c8ae-44ca-b0eb-50f6d8214bc2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments/77e62d4e-6abf-45af-8e39-7eaba129c338" status: 202 len: 0 microversion: 2.1 time: 0.557398 Jul 26 15:39:22.753481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 283/579] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:39:22 2022] DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments/77e62d4e-6abf-45af-8e39-7eaba129c338 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:39:22.759125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:22.760071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:22.771721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.772188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.775258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:22.776195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:22.893480 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.901580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:22.904044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c2e4887f-43fd-44b6-b6be-104166214ac3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1147 microversion: 2.1 time: 0.149667 Jul 26 15:39:22.904689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 284/580] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:22 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1147 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:22.910535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-953d50e7-2f61-4377-8a6a-ddd3f659ebf1 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.294095 Jul 26 15:39:22.911417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 297/581] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:22 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:23.072774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.073643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.082649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.083540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.084744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.085463 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.123905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.124359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.124975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:23.170149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.178468 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ad9e02dd-af3b-4e8b-ad58-8d8724c05d1a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.110668 Jul 26 15:39:23.188975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 285/582] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:23.215389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.216731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.227862 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.230077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.230077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.230077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.315381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.315997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.324545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.325206 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.326184 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.326789 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.396416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.419139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3610f14e-444b-4e9b-a14b-753023bd749d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.208371 Jul 26 15:39:23.420371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 298/583] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:23.516447 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.526840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.529748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.531345 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-de1172cb-5ff1-4042-968d-bd2cf34e6918 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.220438 Jul 26 15:39:23.532457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 286/584] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:23.639350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.640156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.648944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.649412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.650934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.651531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.840821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:23.867612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-19e3767f-71fb-4639-8750-42fa53fed336 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.231673 Jul 26 15:39:23.873526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 299/585] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:23.937156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.938941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.945018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:23.947103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:23.959656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.960100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.962213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.962663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.963441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.964150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:23.964909 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:23.965574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.065467 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.079193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-49b0c1bb-3fa5-4b09-b290-92985c5adc32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1147 microversion: 2.1 time: 0.138357 Jul 26 15:39:24.081233 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 287/586] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1147 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:24.152680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.160998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b02bfbee-ae3b-4c50-9f72-cec6abf11a3f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.227647 Jul 26 15:39:24.161581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 300/587] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:23 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:24.201400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:24.202019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-b20dc211-c545-4e1e-81f3-4f19516ad1b0 req-6f6c6370-28ad-441f-bf0b-c4c41df1fc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "name": "network-vif-plugged", "status": "completed", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:24.202285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:24.208854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.209309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.211611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.212240 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.228195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-b20dc211-c545-4e1e-81f3-4f19516ad1b0 req-6f6c6370-28ad-441f-bf0b-c4c41df1fc92 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.229061 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-b20dc211-c545-4e1e-81f3-4f19516ad1b0 req-6f6c6370-28ad-441f-bf0b-c4c41df1fc92 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.244588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-b20dc211-c545-4e1e-81f3-4f19516ad1b0 req-6f6c6370-28ad-441f-bf0b-c4c41df1fc92 service nova] Creating event network-vif-plugged:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:39:24.250064 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-b20dc211-c545-4e1e-81f3-4f19516ad1b0 req-6f6c6370-28ad-441f-bf0b-c4c41df1fc92 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071426 Jul 26 15:39:24.251166 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 288/588] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:24.255247 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.255709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.256166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:24.299073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.308188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d25dbb63-596c-429d-8b40-00c4635762c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.110879 Jul 26 15:39:24.308846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 301/589] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:24 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:24.445392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:24.446964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:24.456247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.457255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.458421 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.459075 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.559460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:24.560501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:24.575471 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.578545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.579713 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.580375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.687168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.699331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d868f559-f658-4bd4-893b-ca962772511f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.259013 Jul 26 15:39:24.699858 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 289/590] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:24 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:24.835475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.845509 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.847392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:24.848483 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d06cba8d-4691-4a5b-bcdb-42a1040e0a75 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.296603 Jul 26 15:39:24.849047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 302/591] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:24 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:24.895643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:24.896654 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:24.905770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.906892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:24.907243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:24.907805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.097550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:25.107089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-207f2165-4eb1-49a5-9f79-b79f324fd230 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.215837 Jul 26 15:39:25.107680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 290/592] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:24 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:25.220650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:25.221699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:25.223226 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:25.224151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:25.231526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.232431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.233582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.233819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.234202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.238182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.238920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.239380 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.341203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:25.357862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b0bce144-1948-48dd-937d-a06dceb06b1c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1147 microversion: 2.1 time: 0.140862 Jul 26 15:39:25.372537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 291/593] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:25 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1147 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:25.377804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:25.378430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:25.385868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.386687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.387261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.387812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.401028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:25.408958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9dc67b6a-1893-40f6-8bae-f8182e28360d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.192045 Jul 26 15:39:25.409596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 303/594] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:25 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:25.441040 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.441871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.442534 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:25.508626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:25.517649 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e6f07032-da75-42ea-b271-9fef8d19b337 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.143737 Jul 26 15:39:25.520412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 292/595] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:25 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:25.726066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:25.726558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:25.734104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.734504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.735312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.735737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.877817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:25.878445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:25.894915 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.895249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.899172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:25.899385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:25.900283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:25.908572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bdd966b9-ca6c-4916-9218-d27bf0994370 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.186245 Jul 26 15:39:25.909465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 304/596] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:25 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:26.124983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.133888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:26.134622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:26.141519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.143347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.145997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7a4dcb8a-ec50-4eef-b8ad-44bf3539b135 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.271902 Jul 26 15:39:26.147002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 293/597] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:25 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:26.150641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.151238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.152169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.152767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.326455 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.334864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d560e99b-8552-429b-9415-848bade36422 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.207833 Jul 26 15:39:26.335427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 305/598] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:26 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:26.379500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:26.380020 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:26.389395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.389855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.390628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.391063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.436282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:26.436625 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:26.443676 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.444392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.445214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.445739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.466948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.475191 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c41d2b9d-4144-45e9-8ff7-da9bd2a98b4d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1147 microversion: 2.1 time: 0.099500 Jul 26 15:39:26.475696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 294/599] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:26 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1147 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:26.541028 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:26.566426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:26.566426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.567491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.569784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.570734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.658737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.659448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.660932 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:26.731266 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.741358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-70bda626-e38c-4769-a081-2d3038fef845 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.205745 Jul 26 15:39:26.743193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 295/600] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:26 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:26.836994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:26.852787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-15cc3c12-fc68-4b1d-bb95-3ceb74546fb5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.419233 Jul 26 15:39:26.867549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 306/601] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:26 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:26.932571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:26.934729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:26.942607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.944307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:26.945880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:26.946772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.146481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.153501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:27.157645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2d5d21b7-85b7-4470-99f3-8a6b67248e72 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.230546 Jul 26 15:39:27.158812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 296/602] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:26 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:27.174607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:27.175506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:27.187932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.187932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.187932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.187932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.188861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:27.357089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:27.357713 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:27.365200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.365674 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.366493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.366934 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.386959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.396668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.398546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.400068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0e24fcc9-23b4-4f6e-9677-1db72fed33f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.229518 Jul 26 15:39:27.400669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 307/603] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:27 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:27.498903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:27.500526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:27.506972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.507419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.508415 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.509522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.549216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.558777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-88b18cec-1fec-47c8-a8f1-e0157e969667 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.205592 Jul 26 15:39:27.572499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 297/604] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:27 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:27.587312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.602800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-35e68580-0c75-4c2e-a822-876abf3eff69 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1139 microversion: 2.1 time: 0.107760 Jul 26 15:39:27.603389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 308/605] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:27 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1139 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:27.765831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:27.766605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:27.774335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.774770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.775675 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.776109 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.810803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.811244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.811692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:27.863852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:27.876828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d1854f2f-ca1c-4a1a-b369-9a4614812fcd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.114595 Jul 26 15:39:27.880709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:27.880917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 298/606] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:27 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:27.881016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:27.887174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.887629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:27.888413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:27.888876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.052083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.061798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3aafe27b-c698-4688-b166-55466a4678ee tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.188606 Jul 26 15:39:28.062861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 309/607] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:27 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:28.181648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:28.182413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:28.192328 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.192852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.193899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.194478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.377385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.388192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6e0b7e99-3b19-40b0-85cd-68cdca176d94 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.210830 Jul 26 15:39:28.390773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 299/608] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:28 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:28.426218 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:28.426836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:28.434144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.434690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.435535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.436034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.588520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:28.588776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.588921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:28.588921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:28.592051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.592611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.596829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.596829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.597321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.600279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.600279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-74bd95d3-3ed6-4ebd-999f-bb5297679c27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.177897 Jul 26 15:39:28.601302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 310/609] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:28 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:28.623792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:28.624605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:28.633699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.634504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.635832 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.636412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.725958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.734724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-32764e3c-fd5b-4255-a995-c96bad5c9018 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1139 microversion: 2.1 time: 0.114766 Jul 26 15:39:28.748722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 311/610] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:28 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1139 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:28.756271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:28.766046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fc772769-98df-4fbd-bdb8-820d3fc82ace tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.188092 Jul 26 15:39:28.768444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 300/611] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:28 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:28.904734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:28.905246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:28.911705 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.912219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.913063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.920712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.949579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:28.950035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:28.950495 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:28.996328 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.005761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6bebd353-6104-47e6-bbba-37f8847b4151 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.104948 Jul 26 15:39:29.006928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 312/612] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:28 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:29.084060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:29.085047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:29.092353 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.093085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.094051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.094517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.256940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.267163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ac2c2178-9197-4de1-8d6f-c9a895d60c34 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.187034 Jul 26 15:39:29.267986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 301/613] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:29 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:29.411612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:29.412137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:29.419141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.419584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.420375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.420829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.562697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.570444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3bfa5774-3741-4fec-bbdd-fa52f70a9888 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.162536 Jul 26 15:39:29.571378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 313/614] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:29 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:29.625460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:29.626081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:29.634278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.634737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.635523 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.635961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.756707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:29.759545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:29.767750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.768307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.769205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.769715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.795197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.803890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.806123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.807287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-32394d3d-9c86-4ebe-b8e7-299a54c77cd3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.186196 Jul 26 15:39:29.821071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 302/615] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:29 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:29.828748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:29.829358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:29.832241 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:29.835710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.836365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.837252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:29.837886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:29.843015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.853823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-184252cd-b112-4aa3-85a8-59c95f316516 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1139 microversion: 2.1 time: 0.101151 Jul 26 15:39:29.860536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 314/616] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:29 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1139 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:29.976244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:29.985452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eefd1d57-61d7-4730-a869-f11cfe357509 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.163087 Jul 26 15:39:29.986602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 303/617] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:29 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:30.027861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:30.028486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:30.034551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.034999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.035764 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.036209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.067525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.067976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.068425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:30.110811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.118997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e3e737b3-ee4d-48ad-ad96-53afb8b1e3eb tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.094949 Jul 26 15:39:30.119551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 315/618] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:30 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:30.290362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:30.290903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:30.297271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.297799 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.298565 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.298993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.362471 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=10 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:30.433294 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.441086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-228b4f03-5688-493b-beca-e49528676071 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.156015 Jul 26 15:39:30.441660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 304/619] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:30 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:30.591377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:30.592440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:30.598713 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.599167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.599921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.600351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.733394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.740819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d6e8a8c0-9d13-4419-bc46-e2416cc3743d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.153410 Jul 26 15:39:30.741374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 316/620] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:30 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:30.834126 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:30.834643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:30.842376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.842967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.843768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.844205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.877623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:30.878282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:30.884480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.884958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.885723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:30.886154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:30.950137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.957788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bcbaf572-21ee-4e56-8e98-0c288791a0c8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1139 microversion: 2.1 time: 0.083913 Jul 26 15:39:30.958364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 317/621] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:30 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:30.984037 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.993595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.995096 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:30.996244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1769a8be-5e66-422d-93ac-970bd8b85fe8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.166202 Jul 26 15:39:30.996827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 305/622] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:30 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:31.007015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:31.007746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:31.014153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.014674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.015367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.015804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.139745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:31.146874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:31.147160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:31.147614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.148065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.149129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.149567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.154212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e00bd5f8-0d25-402c-883e-e83fa30077f5 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.151009 Jul 26 15:39:31.154785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 318/623] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:31 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:31.182678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.183131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.183673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:31.291268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:31.299476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-93caddf3-bd2d-4d5f-b0a1-b77779758ddf tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.163556 Jul 26 15:39:31.301576 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 306/624] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:31 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:31.462985 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:31.463605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:31.470628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.470991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.471874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.472311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.608804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:31.616250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02cba1a7-fe65-4ea9-bfbe-c19904c52236 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1318 microversion: 2.1 time: 0.158262 Jul 26 15:39:31.616847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 319/625] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:31 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:31.764929 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:31.765605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:31.771531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.771974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.772761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.773936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.909310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:31.917333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-972cb7bf-98fb-47de-b893-fad700c97012 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.157743 Jul 26 15:39:31.917940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 307/626] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:31 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:31.978533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:31.979098 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:31.985496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.985989 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:31.986767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:31.987209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.019359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.020021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.026367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.026812 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.027594 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.028032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.055354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.063425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91394de2-c828-4d88-b162-53b93d238e9d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1195 microversion: 2.1 time: 0.088974 Jul 26 15:39:32.064217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 320/627] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:31 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:32.161989 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.171203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.172804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.173975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-91ec1e33-d148-4b93-b072-6c72054b79c5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.158540 Jul 26 15:39:32.174536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 308/628] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:32 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:32.176634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.177320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.184528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.185114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.185890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.186403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.324443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.325134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.331759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.332215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.333321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.333766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.406312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.406861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.407433 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 065d4125-a5c9-42f0-aaf7-4c8b7250c221 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:32.409041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.419424 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27d22a7b-e3e9-43ef-9df2-8e94493b21f9 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.246829 Jul 26 15:39:32.425553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 321/629] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:32 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:32.465220 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.472289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-351dbb99-218a-436a-b5f2-da2824b953c6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 200 len: 1335 microversion: 2.1 time: 0.154868 Jul 26 15:39:32.473004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 309/630] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:32 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:32.637715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.638324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.645270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.645707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.646468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.646894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.778753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:32.786255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27a26781-29d9-49a2-a3c6-32c338660e94 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1468 microversion: 2.1 time: 0.152431 Jul 26 15:39:32.786825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 322/631] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:32 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:32.831944 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.832434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.838936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.839376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.840125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.840584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.866364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:39:32.939615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:32.940224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:32.946630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.947083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.947851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:32.948289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:32.950840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:32.982457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:33.083565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.092367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f1d40bc8-970b-4030-a964-4a556c40aed4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.156904 Jul 26 15:39:33.093047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 323/632] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:32 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:33.097947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.098624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:33.106056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.109318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.109318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.109318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.125810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a70192fb-59f3-41a0-a43a-e11e3474294e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "DELETE /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 204 len: 0 microversion: 2.1 time: 0.297305 Jul 26 15:39:33.126408 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 310/633] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:39:32 2022] DELETE /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:39:33.135747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.136630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:33.146295 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.146739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.147510 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.147951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.178094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.188228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fa679a75-194a-4556-8ee6-cc87e5c975a7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1195 microversion: 2.1 time: 0.093868 Jul 26 15:39:33.188842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 324/634] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:33 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1195 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:33.207433 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.208056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:33.215035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.215481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.216254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.216725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.329922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.338513 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1e4c8096-a21d-49ab-a7c7-158b65cdf4d3 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.207694 Jul 26 15:39:33.339417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 311/635] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:33 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:33.350915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.359940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.362214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.362651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3ea8c686-9331-4c83-8e20-3561818973cf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.159226 Jul 26 15:39:33.363210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 325/636] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:33 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:33.441881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.442494 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:33.449986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.450537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.451196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.451659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.493519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.494132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:33.500371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.500859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.501636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:33.502074 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:33.516533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 HTTP/1.1 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:39:33.518797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:39:33.520399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '065d4125-a5c9-42f0-aaf7-4c8b7250c221'} Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:39:33.521271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:39:33.522501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:39:33.524311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:39:33.524311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-554e57df-194b-44f4-938f-36049d425821 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 404 len: 111 microversion: 2.1 time: 0.030997 Jul 26 15:39:33.524311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 326/637] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:33 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:39:33.528985 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-15afd4cb-8c4d-4d6b-8e74-0a33cecf27fe tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '.version_select at 0x7f346ac10280>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:33.591852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:33.605578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0bed4b8b-2ab6-4355-934e-1607093e20b7 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.162557 Jul 26 15:39:33.606444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 312/638] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:33 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:33.636125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-15afd4cb-8c4d-4d6b-8e74-0a33cecf27fe tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215107714" status: 202 len: 0 microversion: 2.1 time: 0.110672 Jul 26 15:39:33.636938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 327/639] 10.222.0.128 () {58 vars in 1226 bytes} [Tue Jul 26 15:39:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215107714 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:39:34.113875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.114397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.121553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.122001 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.123152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.123585 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.211595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.212819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.220581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.221344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.222361 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.223129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.260294 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.267825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9f3d0159-7ef3-4fdc-864e-5f9baee0659d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.158009 Jul 26 15:39:34.270670 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 313/640] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:34.287995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.296234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b643e803-a36d-472c-aa7a-7f480269c61d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1195 microversion: 2.1 time: 0.089733 Jul 26 15:39:34.296833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 328/641] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1195 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:34.361019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.361575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.368350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.368350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.369168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.369595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.385635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.386671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.395493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.395961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.396776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.397408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.509897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.518542 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e3f60ab3-edb4-4a35-96a3-213c9af5a276 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.161588 Jul 26 15:39:34.519271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 314/642] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:34.524763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.528749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.531929 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.532575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.533665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.534320 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.563132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.576400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.578029 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.579179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2348528d-d121-42ea-9291-179494514ca5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.198157 Jul 26 15:39:34.579738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 329/643] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:34.629080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'services' on Instance uuid 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:39:34.634735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.635355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.641444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.641887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.642669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.643246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.780619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:34.795110 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-374998c6-09ea-492a-a589-948731e14863 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.164290 Jul 26 15:39:34.796627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 330/644] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:34.903652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-44ccddae-9f75-4f44-b241-966c4257e497 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments/78033d37-231d-4871-b7d7-6169e88cafa4" status: 202 len: 0 microversion: 2.1 time: 0.382944 Jul 26 15:39:34.904843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 315/645] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:39:34 2022] DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments/78033d37-231d-4871-b7d7-6169e88cafa4 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:39:34.913195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:34.916904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:34.926003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.926442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.927759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:34.928358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:34.965204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f2a98b99-df70-4713-9aaa-99919423e60a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056228 Jul 26 15:39:34.965774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 331/646] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:34 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:35.290988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.291695 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.298428 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.298873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.299644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.300104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.317634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.318244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.325641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.326090 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.327063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.327506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.514690 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.522580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-00600dd8-dc69-4cc1-ab6a-ed91e65f3720 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.237224 Jul 26 15:39:35.524042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 316/647] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:35.548017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.548791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.555312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.558327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.558327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.558327 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.706623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.714897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f045ea8d-4492-4220-894f-2fa9c44d810c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.171331 Jul 26 15:39:35.715484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 317/648] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:35.729903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.734663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.735435 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.744535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.745244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.746229 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.746914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.752401 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02ae8d02-0f27-479c-8b68-daaaf9739899 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1203 microversion: 2.1 time: 0.438649 Jul 26 15:39:35.757536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 332/649] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1203 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:35.828814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.829367 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.839026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.839481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.840260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.840738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.893913 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.904263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.906131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.907344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ec913fdd-7bcf-40ca-87e0-47a3468c8f4c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.190708 Jul 26 15:39:35.907902 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 318/650] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:35.980589 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:35.982928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:35.983928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:35.990383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.990827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.991693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:35.992845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:35.994056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c29cf3b2-2217-44b7-a2a1-e1c3b1a2934e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.169211 Jul 26 15:39:35.994737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 333/651] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:36.030856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ddac1cda-84bf-470d-a39e-010c39949e62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056441 Jul 26 15:39:36.031441 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 319/652] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:35 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:36.545496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:36.546106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:36.554797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.555255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.556299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.556704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.698126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:36.705781 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-13b1a45a-8fbe-405c-b22d-60d28a719d4b tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.164149 Jul 26 15:39:36.706343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 334/653] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:36 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:36.738145 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:36.738741 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:36.747964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.747964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.747964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.747964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.779855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:36.780733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:36.787385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.793424 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.793424 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.793424 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.866412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:36.875554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6b1ac059-24ad-43e1-b388-b0e336df1c04 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.099372 Jul 26 15:39:36.876250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 335/654] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:36 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:36.890365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:36.899086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-de35638e-5b68-4965-a6af-97bc3d9c1c26 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.163800 Jul 26 15:39:36.899334 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 320/655] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:36 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:36.931188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:36.931791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:36.939269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.939717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:36.940513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:36.940941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.015348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:37.015952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:37.022615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.023974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.024809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.025526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.081590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.091068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.092613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.093881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ff5db6ff-0a03-4901-ad3f-8b1731e6d6a7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.166707 Jul 26 15:39:37.094444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 336/656] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:36 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:37.099022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:37.101369 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:37.107633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.108093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.108905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.109352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.143048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f6561bbb-5395-49f0-b5e0-06cbd498712f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047405 Jul 26 15:39:37.143523 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 337/657] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:37 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:37.169242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.178146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-88342a04-50d7-4755-8abc-a9a1e9289543 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.166857 Jul 26 15:39:37.178712 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 321/658] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:37 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:37.727828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:37.728584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:37.735343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.735782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.736627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.737136 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.871423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.878988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91c91afd-e623-457a-ba4c-9fec30484c2a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.155056 Jul 26 15:39:37.879540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 338/659] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:37 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:37.897255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:37.898569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:37.905531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.905966 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.913140 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.913140 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.923519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:37.924335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:37.931084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.931535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.932322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:37.932812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:37.974383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:37.982364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bcf30a01-558e-4f6b-af15-f86a81b6e5c3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.088918 Jul 26 15:39:37.982958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 322/660] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:37 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:38.078347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:38.087366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-05843741-dcec-402e-8932-5a1a0b7d8aad tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.167774 Jul 26 15:39:38.087952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 339/661] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:37 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:38.118749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:38.119706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:38.125705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.129557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.129557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.129557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.159210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:38.161740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:38.163911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:38.169033 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.169678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.170578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.170919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.214884 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f279ba5f-9c3b-4ca3-8b8b-7d3e842859e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059519 Jul 26 15:39:38.224528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 340/662] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:38 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:38.229157 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:38.229772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:38.236999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.237442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.238215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.238648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.258411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:38.291004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:38.299935 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:38.301454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:38.302828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-93f476b6-fa2f-463f-9ce1-f39ce66dcfec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.189392 Jul 26 15:39:38.303422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 323/663] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:38 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:38.386838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:38.395808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8d9446a6-7805-4a77-b3c5-f11ddb5310da tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.179311 Jul 26 15:39:38.396452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 341/664] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:38 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:38.901522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:38.906683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:38.908768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.909223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:38.909974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:38.910403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.003151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:39.003769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:39.011416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.011869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.012685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.013133 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.046401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.055343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-09535b48-2397-4edd-ab70-ec181237d55d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.157653 Jul 26 15:39:39.056132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 324/665] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:38 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:39.075730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.083275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8ed38ced-1737-4dc8-a0d0-7a32adc50b7c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.084100 Jul 26 15:39:39.083838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 342/666] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:38 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:39.108095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:39.108723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:39.114710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.115147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.115896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.116852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.229723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:39.232212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:39.238347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.238876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.239643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.240111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.251567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.260139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-622a4911-0f99-452a-8ca8-0556a524ba5c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.155710 Jul 26 15:39:39.261039 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 325/667] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:39 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:39.274690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e1964b13-14ac-43c7-8456-6840b0cd43e3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048981 Jul 26 15:39:39.275277 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 343/668] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:39 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:39.327671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:39.328271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:39.334627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.335119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.335887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.336314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.417881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:39.418466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:39.424954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.425401 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.426163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:39.426594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:39.473491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.478007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:39.483438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.485062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.486228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6ef95c82-6354-4978-9b64-fd2563866621 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.162781 Jul 26 15:39:39.486788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 326/669] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:39 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:39.564782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:39.572918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8d2cff6c-b2a3-4acb-95a2-bd4ca1288945 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.159451 Jul 26 15:39:39.573485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 344/670] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:39 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:40.077076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.077630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.083918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.084358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.085163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.085596 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.105508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.106113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.112631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.113073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.113840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.114270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.177503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.185641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-261211fd-d562-4bed-9aab-db267a67f03b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.084950 Jul 26 15:39:40.186222 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 345/671] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:40.219526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.226878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1f119735-29f6-40e0-a74c-8490d7b3b0fd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.154230 Jul 26 15:39:40.228021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 327/672] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:40.283443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.283967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.287627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.290484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.291264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.291714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.292511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.292952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.298733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.299173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.299949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.300383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.333457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fc2dbf7a-a54b-4d2a-8fbd-fe9155227e50 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049441 Jul 26 15:39:40.334033 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 328/673] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:40.426283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.433859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a7eb4c7d-a237-4eeb-bd42-644c3237c095 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.155250 Jul 26 15:39:40.434449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 346/674] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:40.510561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.511162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.517163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.517599 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.518347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.518774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.594123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:40.594657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:40.601206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.601660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.602488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:40.602925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:40.650914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.659489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.661022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.662215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7b84f180-da88-42b2-a655-361609012959 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.156127 Jul 26 15:39:40.662776 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 329/675] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:40.745199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:40.753347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28aaf846-0fa6-48df-a4a1-7a62cc94fe39 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.163732 Jul 26 15:39:40.753919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 347/676] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:40 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:41.206936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.207529 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.214705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.215365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.216127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.216598 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.248764 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.249528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.256172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.256661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.257466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.257902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.282292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.290465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f76e7c99-e4bc-4943-a696-9225979d68d7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.086788 Jul 26 15:39:41.291052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 330/677] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:41.346279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.353698 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.360062 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.360545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.361375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.361804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.391680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cc751b84-5698-432d-bab3-d675ab068570 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Jul 26 15:39:41.392257 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 331/678] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:41.394167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.402994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2bf90c83-5446-4675-ae14-3f550462c062 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.158013 Jul 26 15:39:41.403562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 348/679] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:41.455672 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.456318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.463887 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.464795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.465126 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.465563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.597710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.605348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a95aeb12-4b4e-47d6-a26e-916fdcf0266c tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.153567 Jul 26 15:39:41.605916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 332/680] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:41.687076 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.687714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.693836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.694279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.695046 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.695479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.775437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:41.776132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:41.782322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.782874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.783719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:41.784162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:41.829843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.838785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.840304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.841487 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f734ea4f-89dd-4104-8f50-ea8586b33d14 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.158715 Jul 26 15:39:41.842054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 349/681] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:41.917223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:41.925325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2fa22a63-615f-4c9c-99d1-9c1ae0eb8d61 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.153995 Jul 26 15:39:41.925898 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 333/682] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:41 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:42.310622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.311225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.318177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.318623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.319410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.319839 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.384117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:42.392126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e15642be-3e0a-45cb-b628-8558655e292a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.085274 Jul 26 15:39:42.392904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 350/683] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:42.403904 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.406249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.412764 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.413209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.413978 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.414415 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.426826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.431248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.435159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.435846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.437303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.438013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.446782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-94be89ef-f1f1-4ee8-903e-99b23b9ef46b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047496 Jul 26 15:39:42.451444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 334/684] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:42.571755 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:42.579740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b6fd089-9570-40df-9bcc-4d5d2f05124c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1363 microversion: 2.1 time: 0.156932 Jul 26 15:39:42.580322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 351/685] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:42.627864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.628485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.646010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.646010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.646010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.646010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.835933 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:42.844103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b78c4937-259d-495e-bb97-a4781b84309a tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1474 microversion: 2.1 time: 0.220224 Jul 26 15:39:42.844708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 335/686] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1474 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:42.865054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.865725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.871868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.876728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.876728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.876728 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.948506 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:42.949420 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:42.955734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.956181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:42.957107 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:42.957545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.017646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.027061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.028747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.030035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4e5d28e9-a9a0-4f0f-b54a-9d3537074138 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.168823 Jul 26 15:39:43.030741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 352/687] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:43.100442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.109431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3fc29181-c24c-42db-a23c-97b34e6978b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.165504 Jul 26 15:39:43.110018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 336/688] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:42 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:43.170590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0f2f2690-338f-4534-9713-d9d071f5c019 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:43.176774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f2f2690-338f-4534-9713-d9d071f5c019 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.177253 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f2f2690-338f-4534-9713-d9d071f5c019 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.201891 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0f2f2690-338f-4534-9713-d9d071f5c019 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Going to try to stop instance {{(pid=124843) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:39:43.409478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0f2f2690-338f-4534-9713-d9d071f5c019 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action" status: 202 len: 0 microversion: 2.1 time: 0.242491 Jul 26 15:39:43.412289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 353/689] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:39:43 2022] POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:39:43.413747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.415250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.421500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.422532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.423150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.423612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.424481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.424978 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.432431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.433258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.434310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.435027 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.523076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.532435 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0693b9cd-d851-483a-b23b-efb840559c75 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1213 microversion: 2.1 time: 0.122849 Jul 26 15:39:43.546793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 337/690] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:43.546793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.546793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.547485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.547927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.548739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.549194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.584724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e21fb530-e3d4-41b6-9420-35e07c54e7aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050235 Jul 26 15:39:43.585541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 338/691] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:43.601814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.603193 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.609970 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.610412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.611172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.611600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.626665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.639912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-75a9eab5-1a90-4518-81d9-aa240bc47bb3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.223403 Jul 26 15:39:43.648560 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 354/692] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:43.815669 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.825033 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a35c9f64-628f-4a7b-ae83-bf3eeee8deb8 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1552 microversion: 2.1 time: 0.227075 Jul 26 15:39:43.826107 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 339/693] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:43.845930 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.846545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.852959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.853386 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.854165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.854596 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.872927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:43.873642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:43.880183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.880681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.881518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:43.882156 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:43.970826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:43.983895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-26402a8c-db78-4b3e-aeec-2460d30a6fac tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.120577 Jul 26 15:39:43.998037 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 340/694] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:44.046344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-3733bb9d-ef07-421b-b182-6e913986df22 req-af559713-f774-459a-8495-a1074bcf7abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c08984-53ba-4b40-8291-6cab95a55413", "name": "network-vif-deleted", "tag": "a3404dc2-300f-46d8-a1fd-9e8938434607"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:44.061113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.061840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-3733bb9d-ef07-421b-b182-6e913986df22 req-af559713-f774-459a-8495-a1074bcf7abe service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.062279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-3733bb9d-ef07-421b-b182-6e913986df22 req-af559713-f774-459a-8495-a1074bcf7abe service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.069579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4904aae7-37f6-4978-bc15-457d8013921e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1552 microversion: 2.1 time: 0.227326 Jul 26 15:39:44.070152 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 355/695] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:43 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1552 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:44.083207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-3733bb9d-ef07-421b-b182-6e913986df22 req-af559713-f774-459a-8495-a1074bcf7abe service nova] Creating event network-vif-deleted:a3404dc2-300f-46d8-a1fd-9e8938434607 for instance 93c08984-53ba-4b40-8291-6cab95a55413 on hv-cinder-85103 Jul 26 15:39:44.083677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-3733bb9d-ef07-421b-b182-6e913986df22 req-af559713-f774-459a-8495-a1074bcf7abe service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041760 Jul 26 15:39:44.084546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 341/696] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:44.090500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.091150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.094983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.097602 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.098232 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.099216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.099812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.101493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.104052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Searching by: {'deleted': False, 'project_id': '7c892ef56ae9488089386d1a733ae3c0'} {{(pid=124842) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 15:39:44.113136 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.113712 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.114579 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.115167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.222472 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.multi_cell_list [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124842) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 15:39:44.333997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.341307 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3fc81ac9-f644-4132-9263-4f65bf60b7ea tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.250602 Jul 26 15:39:44.342093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 342/697] 10.222.0.128 () {58 vars in 1130 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:44.346442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.347205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.347845 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.350126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.351451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4aa9e295-84db-4cd1-b1ea-33fb3de6d2b1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.269640 Jul 26 15:39:44.354052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 356/698] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:44.360282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.360282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.360282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.360282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.360712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.360712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.369118 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.369928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.370804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.371368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.374423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:44.516113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.517991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:44.522387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.523150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e96ae670-46a2-44d1-82fe-6c84bd8dde49 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.180207 Jul 26 15:39:44.523761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 343/699] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:44.530173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-06fb9bf3-66c8-48e6-ad97-91bd4f41d53f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1552 microversion: 2.1 time: 0.175051 Jul 26 15:39:44.530727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 357/700] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:44.553702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.554425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.562269 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.562724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.563496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.563936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.599455 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.602257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.609193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.609641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.610420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.610847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.644413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-295e9648-e41f-4484-b24a-88045dcbf52e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049191 Jul 26 15:39:44.645122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 358/701] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:44.661902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:44.662519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:44.669518 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.669893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.670677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:44.671149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:44.718381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.726141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-67b1dcab-8abf-49a8-b918-ecbc26fcf487 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.176446 Jul 26 15:39:44.726748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 344/702] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:44.819974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:44.828135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7a451b5a-643f-473d-91fc-61cff66c7809 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.170160 Jul 26 15:39:44.828758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 359/703] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:44 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:45.005528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.006132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.013215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.014737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.014737 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.020321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.083328 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.092727 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-05a7b0da-7f1d-4389-b547-b78774293472 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.090994 Jul 26 15:39:45.093407 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 345/704] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:45.381686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.382301 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.389238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.392907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.392907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.392907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.525921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.534487 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.535998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.537183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a7058e41-4496-4d05-9476-75eb30952c94 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.159690 Jul 26 15:39:45.537749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 360/705] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:45.546425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.547074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.553699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.554148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.555592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.556247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.657512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.659787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.668089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.668576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.669423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.669915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.701490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.702359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eb8bb885-aee8-4cd4-ad36-c987185ef66c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048902 Jul 26 15:39:45.703040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 361/706] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:39:45.710611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f84a1715-f6b6-4290-bd5f-923a612c9da8 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.168133 Jul 26 15:39:45.711182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 346/707] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:45.748402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.749072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.755075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.755514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.756271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.756732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.851677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:45.852871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:45.859815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.860437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.861262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:45.861716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:45.901388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:45.910601 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-14f11091-f9aa-4e57-b408-0f80c8c8cfb4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.165718 Jul 26 15:39:45.922904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 362/708] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:46.011088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.019540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c195ca75-0c50-4c6d-a491-344bcf60ebc3 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.172654 Jul 26 15:39:46.020214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 347/709] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:45 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:46.177856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:46.178430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.185380 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.185836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.186888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.187324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.250060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.257706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-81687ab6-0c0e-4658-8b0e-738a8fc01619 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.083872 Jul 26 15:39:46.258280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 363/710] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:46 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:46.500487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4a8405d-6d8a-49a9-ac35-71249fcee2c4"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:46.502914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.505905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:46.509444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.509885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.510701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.511125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.561899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:46.562780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.569857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.570446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.571308 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.572252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.714378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.723099 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.724646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.725815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bfd1372b-2a56-45a4-a510-f45625577b77 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.168280 Jul 26 15:39:46.726418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 364/711] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:46 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:46.734516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:46.734516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.740349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.740837 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.741614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.742055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.771601 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec3cc1e6-cda7-4b1f-a233-11b0793100d9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Jul 26 15:39:46.772089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 365/712] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:46 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:46.777754 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:46.778420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.784678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.789971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.789971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.789971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.924502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:46.932698 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-18bc8b31-e455-461a-8915-3ae2f16a7b68 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.159568 Jul 26 15:39:46.933312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 366/713] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:46 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:46.937974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:46.938579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:46.944513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.944923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:46.945687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:46.946120 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.083818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.092016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2da9bd31-5d32-43f9-9b33-cd3a9e7f7c3b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.157680 Jul 26 15:39:47.092613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 367/714] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:46 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:47.097019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:47.097627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:47.104247 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.104667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.105475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.105937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.242511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.250681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8da53af0-da59-4af5-9470-b4993d2b9e47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.157085 Jul 26 15:39:47.251244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 368/715] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:47 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:47.280943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:47.280943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:47.286872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.287317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.288069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.288530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.355911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.363653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f09c9c70-dc7b-4517-b6d0-61c7d83ab798 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.088885 Jul 26 15:39:47.364217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 369/716] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:47 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:47.749802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:47.750461 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:47.756873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.757326 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.758163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.758647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.897713 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.907243 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.908760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:47.909906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-97df8588-eb55-4ce3-ae98-0aa20e0b2066 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.164026 Jul 26 15:39:47.910504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 370/717] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:47 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:47.915019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:47.918055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:47.925094 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.925785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.926559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.926990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.958219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-254c1f4a-45e1-4ad0-bcd8-73af1e2eeb4d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046679 Jul 26 15:39:47.958785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 371/718] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:47 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:47.964323 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:47.965175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:47.971605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.972053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:47.972857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:47.973345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.119938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:48.128641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9e4181db-f4a9-4bb3-9d14-9138ebfd5546 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.168643 Jul 26 15:39:48.129422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 372/719] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:47 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:48.135227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-71424cd2-079c-430f-bb7d-4c476462d9fc req-600890cd-0532-48f5-aca2-623e5e0f4303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "name": "network-vif-plugged", "status": "completed", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:39:48.144867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-71424cd2-079c-430f-bb7d-4c476462d9fc req-600890cd-0532-48f5-aca2-623e5e0f4303 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.145502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-71424cd2-079c-430f-bb7d-4c476462d9fc req-600890cd-0532-48f5-aca2-623e5e0f4303 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.158675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-71424cd2-079c-430f-bb7d-4c476462d9fc req-600890cd-0532-48f5-aca2-623e5e0f4303 service nova] Creating event network-vif-plugged:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:39:48.166632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-71424cd2-079c-430f-bb7d-4c476462d9fc req-600890cd-0532-48f5-aca2-623e5e0f4303 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Jul 26 15:39:48.167640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 373/720] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:48.173901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:48.174683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:48.181355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.183518 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.183518 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.183518 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.207219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:48.363125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:48.371436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f6b40118-fc41-458b-977e-1bd0038779b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.202545 Jul 26 15:39:48.372141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 374/721] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:48 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:48.376880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:48.377813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:48.386595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.387041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.387824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.388254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.576361 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:48.584325 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d4ed1bbb-c04b-48ad-a71a-89dff7312d22 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.211145 Jul 26 15:39:48.585036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 375/722] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:48 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:48.590427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:48.591043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:48.597620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.598688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.599615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.600656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.667614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:48.675436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28c2058e-bb5d-480a-a661-5fd69d80d69f tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.089391 Jul 26 15:39:48.676035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 376/723] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:48 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:48.936522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:48.937303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:48.944802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.945259 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:48.946036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:48.947308 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.087387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.096895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.098435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.099712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-369be71c-226d-4b63-8a47-8a1885fad0ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.167472 Jul 26 15:39:49.100299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 377/724] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:48 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:49.105274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:49.107557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:49.114179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.114636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.115427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.115872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.150364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-181ad890-4d13-4296-b0eb-c040e788fb11 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Jul 26 15:39:49.150902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 378/725] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:49 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:49.155689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:49.156372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:49.163009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.163472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.164258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.164734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.309964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.318387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-343fcddc-9537-4541-8827-0325b39368aa tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.166515 Jul 26 15:39:49.318953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 379/726] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:49 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:49.393317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:49.393947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:49.400014 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.400552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.401263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.401771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.540281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.548195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bc3790a9-9185-4905-ae9c-5d253ea91a90 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.158742 Jul 26 15:39:49.548791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 380/727] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:49 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:49.606765 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:49.607284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:49.613711 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.614158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.614915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.615347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.753646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.762007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d2dd82d6-e46b-4614-a36e-9ba9dc0a1344 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.159235 Jul 26 15:39:49.762565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 381/728] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:49 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:49.767144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:49.767787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:49.773543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.773984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.774792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:49.775220 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:49.842119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:49.849609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-86f88ee8-e82c-45e6-882c-3e619f716f67 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.086087 Jul 26 15:39:49.850172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 382/729] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:49 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:50.123268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.123949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.130435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.130890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.131641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.132069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.263598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.272228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.273972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.275758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-717f56d4-3443-4da6-82b6-f952612082ec tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.156363 Jul 26 15:39:50.276318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 383/730] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:50.280954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.283158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.289738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.290344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.291146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.291604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.321970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-17f829f0-b043-436c-aaa2-0a50280f9a65 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Jul 26 15:39:50.322488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 384/731] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:50.338803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.339397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.345281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.345722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.346472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.346899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.479173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.487155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-813ab038-ff73-498f-a9de-49feae48993e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.152141 Jul 26 15:39:50.487717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 385/732] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:50.575482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.576763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.585376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.586020 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.588384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.589163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.739881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.748107 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-14c88952-b248-406e-a23e-5c5e19b2dbe9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.180473 Jul 26 15:39:50.748708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 386/733] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:50.782821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.783457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.789462 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.790666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.791411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.791849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.927085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:50.934694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-10f62746-16db-47af-bb1b-a763ab33fcee tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.155550 Jul 26 15:39:50.935261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 387/734] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:50.940021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:50.940668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:50.947049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.947615 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:50.948269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:50.948734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.012114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.019871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5b0da150-bd28-419b-945f-b2bd01c1ca7d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.083658 Jul 26 15:39:51.020439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 388/735] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:50 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:51.298794 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:51.299451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:51.306008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.306452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.307221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.307780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.445469 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.455522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.456970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.458149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ace88f6b-15c2-4c7d-9512-7ed5388f696b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.163416 Jul 26 15:39:51.458708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 389/736] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:51 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:51.463854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:51.466129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:51.467942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:51.473517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.473974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.474760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.475224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.505167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-023da0bf-ca88-47f8-b10a-2f1798f0a820 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Jul 26 15:39:51.505738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 390/737] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:51 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:51.510753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:51.511350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:51.517385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.517830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.518722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.519155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.523291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:51.652009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.660669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-09bf4eb6-5967-44f8-8b3b-cc603e36e8f0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.153933 Jul 26 15:39:51.661238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 391/738] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:51 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:51.768955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:51.769537 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:51.776492 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.776972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.777818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.778274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.911360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:51.919746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-44ae9178-79c2-4ee7-90d3-64b0a22be216 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.154822 Jul 26 15:39:51.920320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 392/739] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:51 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:51.958101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:51.958699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:51.965659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.966106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:51.966954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:51.967388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.101126 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.109398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a8136302-2e61-4b79-823c-dc99f765a430 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.155092 Jul 26 15:39:52.109968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 393/740] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:51 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:52.114405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:52.115011 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:52.120986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.121438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.122209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.122810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.184748 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.192552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-35784eb4-f7cf-4788-b3d1-873931866411 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.081600 Jul 26 15:39:52.193213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 394/741] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:52 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:52.482541 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:52.483137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:52.489665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.490113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.491392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.491830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.631213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.640709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.642311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.643500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b04975d-b192-4ca5-93fb-a91503fb1b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.164901 Jul 26 15:39:52.644063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 395/742] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:52 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:52.648564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:52.650807 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:52.656966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.657419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.658196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.658639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.689024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b1cf6281-d490-420f-8e63-ec007049e453 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Jul 26 15:39:52.689585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 396/743] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:52 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:52.693941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:52.694543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:52.701149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.701595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.702366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.702801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.836239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:52.845719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0337a353-0320-4136-a4be-e682ac764eec tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.155150 Jul 26 15:39:52.846296 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 397/744] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:52 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:52.940924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:52.941526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:52.948155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.948622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:52.949381 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:52.949808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.084162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.091811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-78c9e250-222d-40ba-99e3-65b54a573524 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.154851 Jul 26 15:39:53.092369 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 398/745] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:52 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:53.130038 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:53.130634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:53.136661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.137104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.137858 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.138293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.269079 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.277680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e4817c4d-7c3b-45b0-9803-866796b02ad6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.151308 Jul 26 15:39:53.278256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 399/746] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:53 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:53.282911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:53.283513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:53.289844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.291498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.291989 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.292428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.358822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.366265 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ffc64655-3a59-411d-a6ad-0dc4ec506e5d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.086935 Jul 26 15:39:53.366822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 400/747] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:53 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:53.667514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:53.668149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:53.674609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.675054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.675820 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.676252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.806623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.816007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.817540 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:53.818704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d04153d4-85b9-44bd-9225-045b18d17a90 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.155896 Jul 26 15:39:53.819258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 401/748] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:53 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:53.823751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:53.826139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:53.832174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.832660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.838141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.838141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.863513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-642e6169-a561-40c1-9d1e-c152a1ecd2a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Jul 26 15:39:53.864077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 402/749] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:53 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:53.869193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:53.875209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:53.875731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.876180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:53.876969 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:53.877406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.011513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:54.019818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5c1faacd-847c-48d7-b324-4658868a600c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.154747 Jul 26 15:39:54.020384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 403/750] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:53 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:54.113878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:54.114474 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:54.121611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.122055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.122809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.123245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.155137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:54.255714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:54.263333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f9b10eb-4062-4e61-95d5-4e2d2247c46b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.153850 Jul 26 15:39:54.263902 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 404/751] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:54 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:54.299575 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:54.300180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:54.307130 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.307571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.308335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.308796 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.440167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:54.448236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8dcabf7-0f25-4b26-ac85-0cc7c6a32329 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.152423 Jul 26 15:39:54.448835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 405/752] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:54 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:54.453514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:54.454143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:54.460396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.460914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.461681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.462684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.532577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:54.541430 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1de11a36-6e32-4dae-b23a-f229440475b5 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.090514 Jul 26 15:39:54.542008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 406/753] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:54 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:54.841799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:54.842415 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:54.849036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.849479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.850238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:54.850753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:54.993214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:54.996133 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:55.003111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.007681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.007681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-15f984d2-295b-4a35-a79c-bd56edea63c1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.168722 Jul 26 15:39:55.007681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 407/754] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:54 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:55.011248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:55.013482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:55.019570 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.020021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.020903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.021344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.052241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-285aa46a-bbcd-4068-bb4e-603071a9f263 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Jul 26 15:39:55.052828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 408/755] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:55 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:55.057850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:55.058452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:55.064592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.065050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.065819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.066260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.199861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.207858 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cdd63e2e-2443-480d-8756-1020b6fdfd95 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.154052 Jul 26 15:39:55.208393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 409/756] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:55 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:55.284261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:55.284895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:55.291115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.291683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.292526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.293016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.429171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.437454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-32044e0b-998d-4ce6-b410-f757e999df65 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.157136 Jul 26 15:39:55.438021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 410/757] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:55 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:55.469911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:55.470542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:55.476672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.477117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.477877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.478309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.610527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.617973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9c75e962-a6a0-4bc4-9ce6-e86f549eca31 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.151861 Jul 26 15:39:55.618535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 411/758] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:55 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:55.624213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:55.624827 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:55.630868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.631314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.632078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:55.632532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:55.700272 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:55.708050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9839f343-bc6c-4cab-a8d4-f81298a201fb tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.088405 Jul 26 15:39:55.708644 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 412/759] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:55 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:56.028941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.029545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.036002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.036447 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.037238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.037675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.174569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.183349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.184890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.186332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5b5d343e-8a04-4bcd-8f9e-cb9b056be668 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.161635 Jul 26 15:39:56.186890 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 413/760] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:56.191383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.193645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.199946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.201800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.201800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.201800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.232903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d3bb2986-a49a-4287-988d-31ba7cdaff47 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Jul 26 15:39:56.233473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 414/761] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:56.237826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.238425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.244075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.244881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.245408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.245845 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.382079 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.390784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a7c8b361-ffea-4e95-8e4b-5c1a24e85db4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.156369 Jul 26 15:39:56.391350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 415/762] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:56.460322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.461410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.467880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.468335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.469153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.469595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.603254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=30 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:56.617383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.625683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-88418ba0-485e-42d9-885f-1a2528f8435c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.169218 Jul 26 15:39:56.626260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 416/763] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:56.640311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.640933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.647336 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.647784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.648584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.649023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.783697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.792388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d45f3ee5-ccd2-4838-8cc7-299446374b36 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.154421 Jul 26 15:39:56.792976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 417/764] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:56.797365 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:56.797949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:56.803789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.804228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.805012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:56.805444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:56.869490 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:56.878981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62340f17-b3b8-4e5d-b8a3-119bd8ceeb8d tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.084943 Jul 26 15:39:56.879635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 418/765] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:56 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:57.210109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.210721 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.218714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.219154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.219918 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.220348 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.354573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.362959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.364450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.365618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-adb88e94-8df9-4808-8fe6-7afcf939d4fd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.159407 Jul 26 15:39:57.366167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 419/766] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:39:57.371751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.374125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.380044 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.380508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.381274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.381708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.413030 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-44060b47-780d-4f1e-912f-9e85f15249d7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Jul 26 15:39:57.413774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 420/767] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:57.418638 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.419234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.425322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.425768 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.426527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.426959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.556479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.565474 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-510e73f4-1586-4f8b-be40-b1deb83f1526 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.150680 Jul 26 15:39:57.566042 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 421/768] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:57.646637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.647236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.653299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.654189 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.654486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.654917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.787466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.795517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b2cdc126-b26d-4db1-988a-594bf0b16b1e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.152696 Jul 26 15:39:57.796083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 422/769] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:57.814192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.814797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.820806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.821253 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.822013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.822458 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.955061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:57.962568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7bcb9220-9774-4042-a43a-da5a0929968e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.152399 Jul 26 15:39:57.963778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 423/770] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:57.968314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:57.968948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:57.975003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.975454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.976344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:57.976821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:57.991720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:58.039857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:58.047667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8627135-5720-4693-8852-b1ed8b6e3ed2 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.082924 Jul 26 15:39:58.048293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 424/771] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:57 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:58.390246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:58.390905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:58.397620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.398068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.398842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.399279 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.534970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:58.544763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:58.546207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:58.547359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-763c59d7-ed42-41f2-b813-e6e9ed7fb553 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.161022 Jul 26 15:39:58.547911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 425/772] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:58 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:58.552375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:58.554622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:58.561720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.562166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.562946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.563379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.592847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9608878b-075c-466b-bb6c-3d5ea4d3e3be tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Jul 26 15:39:58.593394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 426/773] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:58 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:58.597738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:58.598335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:58.604433 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.604923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.605688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.606122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.734813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:58.742910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5c540bde-2f43-406d-9697-f343822d5bc0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.148581 Jul 26 15:39:58.743472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 427/774] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:58 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:58.819800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:58.820331 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:58.829716 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.830172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.830966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:58.831402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:58.992984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.003514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1b184922-b5a8-4e8c-9042-ab6651cece38 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.189593 Jul 26 15:39:59.004193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 428/775] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:58 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:39:59.008983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:59.009574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:59.015800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.016278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.017070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.017504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.175493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.190464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c03f317e-4f0d-458d-86d4-0ac9a8d0dea0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.185120 Jul 26 15:39:59.203549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 429/776] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:59 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:59.208361 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:59.209043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:59.215614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.216061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.216866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.217301 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.295672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.303859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ef05bf22-9f13-4d94-b51d-b9fb6829149e tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1432 microversion: 2.1 time: 0.099289 Jul 26 15:39:59.307813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 430/777] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:59 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1432 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:39:59.571290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:59.571993 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:59.578966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.579408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.580167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.580708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.805543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.815797 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.817266 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:39:59.818517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6aeea7fd-3bac-4a0f-a8a0-a1ff3e1306cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.251046 Jul 26 15:39:59.831955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 431/778] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:39:59 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:39:59.839319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:59.842255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:59.848880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.849722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.850777 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.851210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.884305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e56cf1d8-00e8-4419-8a00-2d2e6563da4b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050953 Jul 26 15:39:59.888612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 432/779] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:39:59 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:39:59.914606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:39:59.914606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:39:59.919553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.920015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:39:59.920846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:39:59.923592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.111771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:00.120118 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6c908acd-8e9a-4910-96a0-78efe370cdf3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.229577 Jul 26 15:40:00.121165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 433/780] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:39:59 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:00.126097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:00.126699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:00.139976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.140616 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.141392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.141821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.322528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:00.335422 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad9ee707-821d-4282-b3ac-1a1d936bc158 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.212885 Jul 26 15:40:00.336174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 434/781] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:00 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:00.341113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-1d37afeb-d894-45de-9d93-530c118ffe69 req-e1633d24-3493-462b-9512-8a9b4f10917f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f4641a-1f7d-473c-a239-03183b2ef9b9", "tag": "1bad2d35-9248-4aed-a7c2-1faaec7a1161"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:00.352297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1d37afeb-d894-45de-9d93-530c118ffe69 req-e1633d24-3493-462b-9512-8a9b4f10917f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.352781 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1d37afeb-d894-45de-9d93-530c118ffe69 req-e1633d24-3493-462b-9512-8a9b4f10917f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.366963 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-1d37afeb-d894-45de-9d93-530c118ffe69 req-e1633d24-3493-462b-9512-8a9b4f10917f service nova] Creating event network-changed:1bad2d35-9248-4aed-a7c2-1faaec7a1161 for instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 on hv-cinder-85103 Jul 26 15:40:00.372892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-1d37afeb-d894-45de-9d93-530c118ffe69 req-e1633d24-3493-462b-9512-8a9b4f10917f service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035675 Jul 26 15:40:00.373482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 435/782] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:00.379513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:00.380212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:00.392058 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.392547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.393804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.394201 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.762983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-55a3f455-c1f5-42f9-bc3b-86e857ba7f5d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.266234 Jul 26 15:40:00.769507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 348/783] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:39:46 2022] POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments => generated 194 bytes in 14274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:00.774844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:00.777223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:00.780617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:00.783475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.783991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.784718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.785148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.790253 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33ef0e33-1208-4697-b5eb-5a59ef42969d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.415210 Jul 26 15:40:00.790906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 436/784] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:00 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:00.830186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.830186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.830186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lazy-loading 'fault' on Instance uuid 93c08984-53ba-4b40-8291-6cab95a55413 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:40:00.845164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:00.845800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:00.851930 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.852910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.854294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.854732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.871512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:00.879149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2cccd8db-437d-4953-83af-a2381c2f63ed tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1308 microversion: 2.1 time: 0.108378 Jul 26 15:40:00.879734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 349/785] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:00 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:00.897173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:00.901172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:00.907731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.908733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.910063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:00.910884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:00.954584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-81d2d76c-0e0e-42b4-a5e2-f8c61479712c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061451 Jul 26 15:40:00.955861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 350/786] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:40:00 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:40:01.013039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.020710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.022224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.023378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dadc12d2-7d78-4b80-876a-ff4f8144e991 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.182164 Jul 26 15:40:01.024102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 437/787] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:00 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:40:01.141862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:01.142462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:01.148702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.150899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.150899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.151181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.293018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.299035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b0ee99d6-6876-4ffe-acc7-7cad103c961b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.160455 Jul 26 15:40:01.299281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 351/788] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:01 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:01.357138 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:01.357741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:01.363761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.364204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.364992 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.365440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.499411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.506914 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1d9d8293-e696-49c6-a3c9-bdb630164d64 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.154340 Jul 26 15:40:01.507502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 438/789] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:01 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:01.811658 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:01.812260 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:01.818360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.818794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.819553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.819983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.901529 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:01.902129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:01.908305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.908791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.909611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.910044 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.938756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:01.942506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.942961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.943409 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lazy-loading 'fault' on Instance uuid 93c08984-53ba-4b40-8291-6cab95a55413 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:40:01.954915 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.963158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3610cfb7-0655-4196-b9bf-0b634c5eb406 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.155637 Jul 26 15:40:01.964036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 352/790] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:01 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:01.968872 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:01.971179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:01.977385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.977910 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.978750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:01.979300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:01.985355 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c746449a143140fc87ee685c4fc5f3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd432a53d4fc44e8e9e557f7e3bca2c47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:01.992993 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c4df2ea7-e46d-43db-9912-993f5abe2be0 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 200 len: 1308 microversion: 2.1 time: 0.095382 Jul 26 15:40:01.993727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 439/791] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:01 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:02.009483 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-066121ca-0a36-40f8-82b9-9d10bbd87532 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Jul 26 15:40:02.010051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 353/792] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:40:01 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:02.046405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:02.047004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:02.053018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.053469 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.054225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.054657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.189907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:02.200008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:02.208394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:02.208394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2d301311-7811-4255-8207-46956d0c2cac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.160340 Jul 26 15:40:02.208394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 440/793] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:02 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:40:02.322680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:02.322680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:02.327683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.328119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.328966 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.329395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.462517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:02.471223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8549664b-e3e9-439e-ace1-351825f9d12b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.155042 Jul 26 15:40:02.471795 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 354/794] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:02 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:02.529115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:02.529717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:02.536200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.536689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.537449 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.537882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.553271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:02.711580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:02.717868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-35c3565b-d021-4c8a-b702-95bfa3281db4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.193384 Jul 26 15:40:02.718809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 441/795] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:02 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:02.986638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:02.987274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:02.993385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.993827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:02.994639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:02.996232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.014414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.015401 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] [instance: 93c08984-53ba-4b40-8291-6cab95a55413] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.021991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.022443 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.023224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.023665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.037639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] HTTP exception thrown: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Request method failure captured: Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 HTTP/1.1 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Ap9eoLtlMQ1RgdEu6W29APSegJsCH8DqwyQrkvIXuyCSAuoEoirabFbBjlNN_OzGyve_QP5Tcm3Tm2PZeS5mfOTd6ueyTD-bYKyO0ArlATAuwa9nUmVLo6tnB4ksY6aN_ji2gY-FiEe6fVjvMQ7a3R2e3ZhNy-lTRN0m77Q0EoR8tk Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: d432a53d4fc44e8e9e557f7e3bca2c47 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-1819568523 Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:40:03.039302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/d432a53d4fc44e8e9e557f7e3bca2c47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_d432a53d4fc44e8e9e557f7e3bca2c47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/d432a53d4fc44e8e9e557f7e3bca2c47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/d432a53d4fc44e8e9e557f7e3bca2c47"}]}] Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-1819568523 Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: d432a53d4fc44e8e9e557f7e3bca2c47 Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-1819568523 Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-1819568523-project Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c746449a143140fc87ee685c4fc5f3ea Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-1819568523-project Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. Jul 26 15:40:03.040771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '93c08984-53ba-4b40-8291-6cab95a55413'} Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:40:03.042181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. Jul 26 15:40:03.043576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:03.045320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] Returning 404 to user: Instance 93c08984-53ba-4b40-8291-6cab95a55413 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:40:03.045320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-801ec7cb-8d06-4b12-a5d8-13f595200237 tempest-VolumesNegativeTest-1819568523 tempest-VolumesNegativeTest-1819568523-project] 10.222.0.128 "GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413" status: 404 len: 111 microversion: 2.1 time: 0.030413 Jul 26 15:40:03.045320 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 442/796] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/93c08984-53ba-4b40-8291-6cab95a55413 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:40:03.050657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.053047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.063119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.063574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.064417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.065030 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.096852 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9f5c677a-8f85-4d0c-bf7c-9fecd788ad09 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049654 Jul 26 15:40:03.102312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 443/797] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:40:03.142279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.150155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-55a505e3-feff-4372-881e-ad093f2b75ac tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.167368 Jul 26 15:40:03.150724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 355/798] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:02 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:03.165546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.166080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.173802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.174245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.175241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.175824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.206473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:40:03.225443 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.227746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.235434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.236073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.237125 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.237626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.393281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.403540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.405092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.406341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ce155af4-99e6-4a35-8c5d-d8158e9f9884 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.185095 Jul 26 15:40:03.406967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 356/799] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:40:03.492899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.495389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.500680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.501143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.501919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.502653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.506504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dd4d8692-8162-42b5-99eb-0166709862ae tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 204 len: 0 microversion: 2.1 time: 0.344701 Jul 26 15:40:03.512410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 444/800] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:40:03 2022] DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:40:03.527141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.527989 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.535722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.536347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.537150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.537585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.659043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.668522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ccd932e8-6d35-435e-be2d-626440141404 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.179855 Jul 26 15:40:03.669055 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 357/801] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:03.678787 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.687101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f122f660-aaf1-4d1b-aaad-b2ab73599c25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1682 microversion: 2.1 time: 0.173196 Jul 26 15:40:03.687666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 445/802] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:03.739860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:03.740706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:03.747631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.747802 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.748588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:03.749030 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:03.899524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:03.909535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-205d0629-7f2f-46c5-8a0e-e87ae9d1d72f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.171546 Jul 26 15:40:03.909535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 358/803] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:03 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:04.172940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:04.174925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:04.181139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.181589 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.183551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.183994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.337971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.362593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-77fce88d-ef45-4c84-bae1-3bc7708b1375 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.178082 Jul 26 15:40:04.362593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 446/804] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:04 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:04.429844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:04.430455 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:04.437933 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.438324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.439080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.439507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.576389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.585558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.587069 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.589485 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f7cb717d-1275-45cf-94e0-c64c99fa27f6 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.162726 Jul 26 15:40:04.590466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 359/805] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:04 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:40:04.690155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:04.690718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:04.698383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.699144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.700072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.700687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.708865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:04.709879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:04.733192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.733192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.733192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.733192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.848620 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.858675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-239a2666-e494-4924-819e-a1c02613fd28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.172637 Jul 26 15:40:04.859264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 447/806] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:04 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:04.860333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:04.867987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d955620d-a5fe-4cb6-9874-394e2ff3a3ce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1682 microversion: 2.1 time: 0.162991 Jul 26 15:40:04.868577 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 360/807] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:04 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:04.928781 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:04.929384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:04.935988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.936435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:04.937219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:04.937663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.075741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:05.083598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-527a207c-67dd-488b-b54b-3eb5d1e0c49b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.158560 Jul 26 15:40:05.086153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 448/808] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:04 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:05.371289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:05.372035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:05.378211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.378665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.379442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.379882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.536042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:05.544593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-64c9b5a0-82e2-4d14-b62c-110e4c4bbea4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.178548 Jul 26 15:40:05.549316 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 361/809] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:05 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:05.612562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:05.613079 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:05.619587 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.621868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.621868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.621868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.759772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:05.769305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:05.770798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:05.771949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-51deac30-77c4-4215-9edd-01af52220730 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1812 microversion: 2.20 time: 0.163450 Jul 26 15:40:05.779552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 449/810] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:05 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:40:05.880934 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:05.881548 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:05.889185 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.889555 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:05.889850 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.890550 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:05.890676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.891049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.900089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.901291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:05.902397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:05.903105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.052661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.061001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.062908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d0eb66f1-ea62-4306-84fe-745db2c23bb3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1739 microversion: 2.1 time: 0.186018 Jul 26 15:40:06.070772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-55740687-f821-4782-9096-6670c0b4d2a6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1682 microversion: 2.1 time: 0.185478 Jul 26 15:40:06.071322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 450/811] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:05 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:06.086679 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 362/812] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:05 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:06.106847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:06.107465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:06.123050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.123503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.125851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.126332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.297306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.304999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1251bb71-8801-4b1b-b921-4c0e1214e7ad tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1280 microversion: 2.1 time: 0.203341 Jul 26 15:40:06.319414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 451/813] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:06 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:06.567052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:06.567785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:06.574382 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.574824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.575583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.576013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.734568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.738118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:06.742729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a6e8a5f1-3a3f-492a-b9d9-e0c98aa2f4b6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.179646 Jul 26 15:40:06.743423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 363/814] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:06 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:06.800507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:06.800507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:06.802815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.803264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.804217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:06.804682 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:06.947547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.959641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.962085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:06.963562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-058f1943-4fce-41be-8fdc-9c2167385d53 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1799 microversion: 2.20 time: 0.172324 Jul 26 15:40:06.964427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 452/815] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:40:06 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1799 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:40:07.095025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:07.095025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.095223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:07.095223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.099532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.099978 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.101052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.101677 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.105024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.110036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.127010 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.127662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.354558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:07.372968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cfa68e3f-c697-49d9-a05c-6cf497c02a28 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1719 microversion: 2.1 time: 0.282498 Jul 26 15:40:07.372968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 364/816] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:07 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1719 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:07.382191 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:07.384041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.395919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.396757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.398995 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.400186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.441122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:07.456673 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28bb75a0-4128-44f1-ba6e-6df42e852b66 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1682 microversion: 2.1 time: 0.367107 Jul 26 15:40:07.464848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 453/817] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:07 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1682 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:07.521927 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:07.524297 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.530378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.530908 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.531766 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.532291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.567676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:07.577589 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6bc0ec31-c028-4552-aca3-6abaaca3efd3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.209979 Jul 26 15:40:07.578356 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 365/818] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:07 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:07.741626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] HTTP exception thrown: Cannot 'detach_volume' instance e1394b46-b21c-48f5-96e4-881de63f22c2 while it is in vm_state rescued Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Request method failure captured: Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments/ec2e11e9-8a1f-416a-a579-08bd266c67dc HTTP/1.1 Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am6GpGsOgmODNq_wbmCNv7IogT8hHP3CLk4Y6q8hnPGDFBZdj2sLjrVY5DnRevgzo7I3H2FPXCqZUcDYpR_pmziYfgRgguD1-cA1cEEE7eQK1MTx1PU_ajeeybBk5FKYBslmtnz7G7xJl5JOEPQOU6NIV9MTZSVn3HyDDEpa_o5yOw Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: cc117969e9394769a471d512ce80734a Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:40:07.744358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_cc117969e9394769a471d512ce80734a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/cc117969e9394769a471d512ce80734a"}]}] Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: cc117969e9394769a471d512ce80734a Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2bf7ea384a142d1bc23b23ab503fca0 Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:40:07.746207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Cannot 'detach_volume' instance e1394b46-b21c-48f5-96e4-881de63f22c2 while it is in vm_state rescued Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'server_id': 'e1394b46-b21c-48f5-96e4-881de63f22c2', 'id': 'ec2e11e9-8a1f-416a-a579-08bd266c67dc'} Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:40:07.747034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e1394b46-b21c-48f5-96e4-881de63f22c2 while it is in vm_state rescued Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e1394b46-b21c-48f5-96e4-881de63f22c2 while it is in vm_state rescued Jul 26 15:40:07.748892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:40:07.752623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Returning 409 to user: Cannot 'detach_volume' instance e1394b46-b21c-48f5-96e4-881de63f22c2 while it is in vm_state rescued {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:40:07.753687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0680a72d-06eb-4ea4-ac7d-280d7f980db0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments/ec2e11e9-8a1f-416a-a579-08bd266c67dc" status: 409 len: 152 microversion: 2.1 time: 0.239676 Jul 26 15:40:07.754471 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 454/819] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:40:07 2022] DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments/ec2e11e9-8a1f-416a-a579-08bd266c67dc => generated 152 bytes in 241 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 15:40:07.767016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:07.767016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.774697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:07.775557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:07.776794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.777460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.778882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.779444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.793992 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.795202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:07.796171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:07.796807 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.013749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1d3006f3-fe72-4e09-9ecd-56efdfbe5a1b tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/action" status: 202 len: 0 microversion: 2.1 time: 0.253794 Jul 26 15:40:08.014848 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 366/820] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:40:07 2022] POST /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:40:08.038911 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:08.039913 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:08.048181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.049054 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.050072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.050673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.359722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:08.368010 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3fc3ac99-9e3a-4948-b806-815f00f68f4c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.599311 Jul 26 15:40:08.368874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 455/821] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:07 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:08.488567 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:08.489385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:08.496844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.497493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.498463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.499150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.589427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:08.607911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02ca0b58-928f-4ba5-a3a4-77d45c126585 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1614 microversion: 2.1 time: 0.125010 Jul 26 15:40:08.608808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 456/822] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:08 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:08.614734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:08.615356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:08.629212 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:08.630410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.630877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.631781 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.632230 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.641782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1c3e91fa-4dcd-4a0c-adc0-e85f0f11751d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1727 microversion: 2.1 time: 0.612223 Jul 26 15:40:08.644650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 367/823] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:08 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1727 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:08.646769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:08.664946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-da2aeb3a-389a-4561-8328-fb9ea5f2c806 req-92ddaedc-ff47-41a4-af07-f148e04f5a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a", "name": "network-vif-deleted", "tag": "096e1cf8-00e9-43b3-ab30-7af29a5b4795"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:08.683351 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-da2aeb3a-389a-4561-8328-fb9ea5f2c806 req-92ddaedc-ff47-41a4-af07-f148e04f5a90 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:08.684128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-da2aeb3a-389a-4561-8328-fb9ea5f2c806 req-92ddaedc-ff47-41a4-af07-f148e04f5a90 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:08.698138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-da2aeb3a-389a-4561-8328-fb9ea5f2c806 req-92ddaedc-ff47-41a4-af07-f148e04f5a90 service nova] Creating event network-vif-deleted:096e1cf8-00e9-43b3-ab30-7af29a5b4795 for instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a on hv-cinder-85103 Jul 26 15:40:08.708512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-da2aeb3a-389a-4561-8328-fb9ea5f2c806 req-92ddaedc-ff47-41a4-af07-f148e04f5a90 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045571 Jul 26 15:40:08.709610 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 368/824] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:08.838729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:08.846784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ede47de8-7b9e-4bcd-b729-8144ae1f8bd2 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.236822 Jul 26 15:40:08.847372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 457/825] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:08 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:09.394750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:09.395726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:09.402355 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.402811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.403695 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.404142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.601486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:09.611086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-821a4f38-b0b8-447c-972a-28036fe1a75d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.220575 Jul 26 15:40:09.611671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 369/826] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:09 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:09.638406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:09.639710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:09.649168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.650830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.651994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.657433 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.666873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:09.667642 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:09.680426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.681908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.683245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.684014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.711652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.712606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.715269 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:40:09.803287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:09.816715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0d66feba-d59a-4c3b-bdc7-43111c669b60 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 200 len: 1334 microversion: 2.1 time: 0.185260 Jul 26 15:40:09.833314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 458/827] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:09 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:09.868881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:09.869563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:09.876226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.876869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:09.877735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:09.878188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:10.035242 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:10.051157 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b0612174-1cbc-4cea-9f1d-b8e8846ec134 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.186108 Jul 26 15:40:10.053049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 459/828] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:09 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:10.140620 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:10.150088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7f84bb66-2af5-4afd-97f0-d62093585c47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1727 microversion: 2.1 time: 0.487384 Jul 26 15:40:10.151249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 370/829] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:09 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1727 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:10.633264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:10.634008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:10.642147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:10.642822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:10.643391 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:10.643825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:10.787248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:10.795610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a2fa2e9-f31c-44e4-8482-4def3536fc17 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.166593 Jul 26 15:40:10.796177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 460/830] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:10 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:10.848872 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:10.849512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:10.856235 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:10.856718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:10.857473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:10.857902 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:10.871866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a HTTP/1.1 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:40:10.887490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:40:10.889194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a'} Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:40:10.890017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:40:10.891163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:40:10.892436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:40:10.892436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f3839b06-1a08-4101-a8f7-454659933604 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 404 len: 111 microversion: 2.1 time: 0.029931 Jul 26 15:40:10.892436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 371/831] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:10 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:40:10.894724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b3179d03-882c-4060-8b9d-45b6ce16b5b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '.version_select at 0x7f347338b790>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:10.969602 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b3179d03-882c-4060-8b9d-45b6ce16b5b5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-617595212" status: 202 len: 0 microversion: 2.1 time: 0.078812 Jul 26 15:40:10.970187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 461/832] 10.222.0.128 () {58 vars in 1223 bytes} [Tue Jul 26 15:40:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-617595212 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:40:11.080927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:11.081694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:11.088041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.088676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.089457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.089898 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.172777 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:11.173634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:11.180186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.180674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.181953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.182617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.265811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:11.272219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3156f37c-66c5-4c0c-b622-26cbb1fcbd6a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.198040 Jul 26 15:40:11.272832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 372/833] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:11 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:11.465405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:11.473836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fc926a2e-8843-41be-9f8a-d1b2d4d52ae4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1727 microversion: 2.1 time: 0.305520 Jul 26 15:40:11.474461 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 462/834] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:11 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1727 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:11.827329 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:11.827937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:11.834605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.835055 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.837400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:11.838706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:11.884192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cae3796c-a4bc-4145-a98e-5372aac74dd8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: .version_select at 0x7f3473435670>, body: {"keypair": {"name": "tempest-keypair-1713262974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHfZtdJrovAPuAQKvQfl9bZs1GRCcByNbMFHuqwY224cp+1GpR6O7702ji9LnUNHNAbf+S2dDAlDCLIPjIHW5sCPibPajnXBtu+dwtLDcMSQlZ4kjWE6d37cDpPNAXz0w=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:11.898161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-cae3796c-a4bc-4145-a98e-5372aac74dd8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:40:11.902865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-cae3796c-a4bc-4145-a98e-5372aac74dd8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:40:11.987305 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:11.995106 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e8b336e7-1390-45df-9dba-c353bc71e1eb tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.171691 Jul 26 15:40:11.995673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 373/835] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:11 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:12.015102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cae3796c-a4bc-4145-a98e-5372aac74dd8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137510 Jul 26 15:40:12.015693 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 463/836] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:40:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:40:12.297778 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:12.298715 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:12.311323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.312964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.313499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.314270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.477810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:12.485939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-77adcea1-56f5-4326-9520-d0bd38900688 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.193111 Jul 26 15:40:12.487023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 374/837] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:12 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:12.498257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:12.498869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:12.505420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.505867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.506635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.507085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.643132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:12.651745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2eb753e9-7cf9-407b-a70f-ee7b5320dd51 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1733 microversion: 2.1 time: 0.158849 Jul 26 15:40:12.652315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 464/838] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:12 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:12.677032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:12.677883 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:12.692052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.692956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.694517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:12.695752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:12.784495 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-575fc23d-ba3f-4699-bf96-135dd8c9c834 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114692 Jul 26 15:40:12.785394 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 375/839] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:40:12 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:13.017177 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:13.017802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:13.024437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:13.024948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:13.026548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:13.026994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:13.274907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:13.284049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7fd325af-6358-4563-9be7-d205791a1c1d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.270812 Jul 26 15:40:13.284725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 465/840] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:13 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:13.629689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:13.629689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:13.629689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:13.629689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:13.630847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:13.630847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:13.744538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:13.756434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d264bf8e-16e3-40f9-b9ae-b901c7d7dfcf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.250906 Jul 26 15:40:13.758262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 376/841] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:13 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:14.258942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-86a7c9fa-c29a-4bac-91de-8634e5f73daa req-1f4b7e24-003c-4fe5-a9c9-cdba074e6c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:14.278695 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-86a7c9fa-c29a-4bac-91de-8634e5f73daa req-1f4b7e24-003c-4fe5-a9c9-cdba074e6c1b service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:14.279289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-86a7c9fa-c29a-4bac-91de-8634e5f73daa req-1f4b7e24-003c-4fe5-a9c9-cdba074e6c1b service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:14.297208 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-86a7c9fa-c29a-4bac-91de-8634e5f73daa req-1f4b7e24-003c-4fe5-a9c9-cdba074e6c1b service nova] Creating event network-changed:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:40:14.307052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:14.308171 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:14.324077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-86a7c9fa-c29a-4bac-91de-8634e5f73daa req-1f4b7e24-003c-4fe5-a9c9-cdba074e6c1b service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068613 Jul 26 15:40:14.325409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:14.325747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 466/842] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:14.325899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:14.326633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:14.327116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:14.555405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:14.566985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e48b7930-6b06-4da9-a0be-7dc77ced777c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.264609 Jul 26 15:40:14.567574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 377/843] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:14 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:14.753366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-213139883", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44aad34-88bd-4a3d-a4b4-00a0a6488a28"}], "security_groups": [{"name": "tempest-securitygroup--632680175"}], "key_name": "tempest-keypair-1713262974", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:14.780904 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:14.782470 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:14.791332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:14.791957 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:14.792899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:14.793431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:14.958465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] validate_networks() for [('c44aad34-88bd-4a3d-a4b4-00a0a6488a28', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:40:15.120989 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:15.135505 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d5b49c20-ec25-47c9-a357-f96e17622708 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.358695 Jul 26 15:40:15.151801 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 378/844] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:14 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:15.472124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:40:15.477174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:40:15.477174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:40:15.477174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:40:15.477174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:40:15.487104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:15.487553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:15.489052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:15.489489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:15.512808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:40:15.517505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:40:15.529953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:40:15.532350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:40:15.592344 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:15.592991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:15.599711 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:15.600208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:15.601137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:15.601574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:15.628525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cc32ae7c-e7b0-445f-af77-2e0a528d6073 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.879828 Jul 26 15:40:15.629286 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 467/845] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:40:14 2022] POST /compute/v2.1/servers => generated 403 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:40:15.641446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-24c10e29-035f-43a1-916e-aaf23d83098c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:15.642061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-24c10e29-035f-43a1-916e-aaf23d83098c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:15.699511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-24c10e29-035f-43a1-916e-aaf23d83098c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:15.711200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-24c10e29-035f-43a1-916e-aaf23d83098c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1245 microversion: 2.1 time: 0.073358 Jul 26 15:40:15.711822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 468/846] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:15 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:15.773165 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:15.782780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bc6e2c59-9b23-4288-93b4-a65d6ffc9340 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1680 microversion: 2.1 time: 0.195214 Jul 26 15:40:15.783604 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 379/847] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:15 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:16.165500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:16.166527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:16.168002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:16.168666 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:16.175021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.175469 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.176243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.176720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.178170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.178843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.179960 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.180583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.350881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:16.351290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:16.356527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ebb7fff-dc07-4cb6-8cd0-a3f4b67f975c tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.194758 Jul 26 15:40:16.356705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b176d1c0-9902-4181-ba2a-0d89f0033e97 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1598 microversion: 2.1 time: 0.192569 Jul 26 15:40:16.357211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 380/848] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:16 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:16.364857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 469/849] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:16 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:16.365009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-5fac5f9e-a505-446f-82c0-bf279c480035 req-bfa80c3c-f5a5-4294-a073-396c9b21dad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:16.372370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5fac5f9e-a505-446f-82c0-bf279c480035 req-bfa80c3c-f5a5-4294-a073-396c9b21dad4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.378450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5fac5f9e-a505-446f-82c0-bf279c480035 req-bfa80c3c-f5a5-4294-a073-396c9b21dad4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.378450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:16.386582 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-5fac5f9e-a505-446f-82c0-bf279c480035 req-bfa80c3c-f5a5-4294-a073-396c9b21dad4 service nova] Creating event network-changed:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:40:16.391770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-5fac5f9e-a505-446f-82c0-bf279c480035 req-bfa80c3c-f5a5-4294-a073-396c9b21dad4 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033369 Jul 26 15:40:16.392593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 381/850] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:16.733166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:16.734385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:16.736378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:16.741491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.741968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.742774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.743211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.807114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:16.808438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:16.817489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.818215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.819197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:16.819630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:16.843118 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:16.869788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e277fa64-9e19-4264-97d3-087c7d2d1597 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1249 microversion: 2.1 time: 0.141059 Jul 26 15:40:16.870982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 470/851] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:16 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1249 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:17.072968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:17.085099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-051b3a5a-2950-48de-bf42-33b70f933d2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1657 microversion: 2.1 time: 0.283304 Jul 26 15:40:17.085771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 382/852] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:16 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1657 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:17.119857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bd688b28-6dde-4070-b2d3-3a50af74ff90 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:17.129661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd688b28-6dde-4070-b2d3-3a50af74ff90 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.130315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd688b28-6dde-4070-b2d3-3a50af74ff90 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.156872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bd688b28-6dde-4070-b2d3-3a50af74ff90 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Going to try to start instance {{(pid=124843) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:40:17.387040 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:17.387768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:17.394956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.395661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.396436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.396900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.419944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bd688b28-6dde-4070-b2d3-3a50af74ff90 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action" status: 202 len: 0 microversion: 2.1 time: 0.309998 Jul 26 15:40:17.420892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 471/853] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:40:17 2022] POST /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:40:17.429467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:17.434175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:17.441688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.442147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.443214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.443840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.566079 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:17.574473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7e63432f-924f-45d4-8cd2-ed2d457e486d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.192387 Jul 26 15:40:17.575060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 383/854] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:17 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:17.695052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:17.703580 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-24406361-008b-4282-883f-ce5c8949407c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1666 microversion: 2.1 time: 0.278440 Jul 26 15:40:17.704171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 472/855] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:17 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1666 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:17.892525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:17.893092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:17.900963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.901899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:17.902687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:17.903401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.006748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:18.032342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-51fb6009-6d25-448a-ad32-2c63f1f9966d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1297 microversion: 2.1 time: 0.129830 Jul 26 15:40:18.036320 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 384/856] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:17 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:18.237152 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-7523f9c3-4441-4035-b89f-b7b1dbf2ef30 req-cb321984-c8a9-4710-a369-df4940645707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4641a-1f7d-473c-a239-03183b2ef9b9", "name": "network-vif-plugged", "status": "completed", "tag": "1bad2d35-9248-4aed-a7c2-1faaec7a1161"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:18.248113 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7523f9c3-4441-4035-b89f-b7b1dbf2ef30 req-cb321984-c8a9-4710-a369-df4940645707 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:18.248593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7523f9c3-4441-4035-b89f-b7b1dbf2ef30 req-cb321984-c8a9-4710-a369-df4940645707 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.262335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-7523f9c3-4441-4035-b89f-b7b1dbf2ef30 req-cb321984-c8a9-4710-a369-df4940645707 service nova] Creating event network-vif-plugged:1bad2d35-9248-4aed-a7c2-1faaec7a1161 for instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 on hv-cinder-85103 Jul 26 15:40:18.268129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-7523f9c3-4441-4035-b89f-b7b1dbf2ef30 req-cb321984-c8a9-4710-a369-df4940645707 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034553 Jul 26 15:40:18.269419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 473/857] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:18.597715 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:18.598458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:18.605413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:18.605867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.606638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:18.607325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.725945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:18.728508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:18.734077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:18.734563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.735431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:18.735876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:18.788568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:18.797591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0d206fe7-fe51-4c41-aab3-84b2b79a5e34 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.203668 Jul 26 15:40:18.798573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 385/858] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:18 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:19.058222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:19.058917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:19.065963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.066401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.067165 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.067601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.136586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:19.144377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c6339f9f-a0a7-4fc2-9e21-dc27c60a4f53 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1303 microversion: 2.1 time: 0.090142 Jul 26 15:40:19.145020 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 386/859] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:19 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:19.337156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:19.346868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e3439b00-89fc-4b7b-9455-5b275334d0cc tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1666 microversion: 2.1 time: 0.625550 Jul 26 15:40:19.348689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 474/860] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:18 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1666 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:19.760680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-8267fc13-5e58-424b-a67f-4a14bc884f68 req-6def51ca-a9af-4fe2-879b-882da4529886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:19.791754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-8267fc13-5e58-424b-a67f-4a14bc884f68 req-6def51ca-a9af-4fe2-879b-882da4529886 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.794724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-8267fc13-5e58-424b-a67f-4a14bc884f68 req-6def51ca-a9af-4fe2-879b-882da4529886 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.834724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:19.834724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:19.835257 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-8267fc13-5e58-424b-a67f-4a14bc884f68 req-6def51ca-a9af-4fe2-879b-882da4529886 service nova] Creating event network-changed:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:40:19.835619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.835619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.835619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.835964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.839714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-8267fc13-5e58-424b-a67f-4a14bc884f68 req-6def51ca-a9af-4fe2-879b-882da4529886 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083421 Jul 26 15:40:19.844104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 387/861] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:20.015952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:20.035844 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3a437529-c504-4031-b591-6b1a146181db tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.220332 Jul 26 15:40:20.053150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 475/862] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:19 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:20.167997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:20.168759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:20.176489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:20.176881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:20.177676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:20.178112 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:20.340247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:20.348557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-28a7cbf5-95d6-43dd-85cf-f810b96851e9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.186076 Jul 26 15:40:20.349292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 388/863] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:20 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:20.373176 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:20.373798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:20.379955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:20.380416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:20.381295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:20.381744 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:20.557757 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:20.566870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0c159cb5-a63e-4633-86fe-e6c1707a5f87 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1670 microversion: 2.1 time: 0.196989 Jul 26 15:40:20.567439 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 476/864] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:20 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:21.059807 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:21.060624 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:21.067068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:21.067347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:21.068070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:21.068529 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:21.232990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:21.245701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8f35cc4c-7a59-4a46-9187-a51adae96786 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1268 microversion: 2.1 time: 0.189929 Jul 26 15:40:21.260005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 389/865] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:21 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:21.370364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:21.370982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:21.378749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:21.379455 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:21.379968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:21.380754 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:21.398792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:21.525317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:21.533452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-596fdc13-9461-446d-aea7-d62e8ae66b6a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.167929 Jul 26 15:40:21.536612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 477/866] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:21 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:21.861633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-4489b31d-d899-4168-995a-32c397c3e195 req-4ee53b9f-673e-4f6d-9f85-03a3192b57f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81603c0d-50b8-4ca7-8487-8063b5ec69e7", "tag": "3f832667-173e-45d5-bdc2-2c4340f882ab"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:21.873748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4489b31d-d899-4168-995a-32c397c3e195 req-4ee53b9f-673e-4f6d-9f85-03a3192b57f1 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:21.874398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4489b31d-d899-4168-995a-32c397c3e195 req-4ee53b9f-673e-4f6d-9f85-03a3192b57f1 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:21.887258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-4489b31d-d899-4168-995a-32c397c3e195 req-4ee53b9f-673e-4f6d-9f85-03a3192b57f1 service nova] Creating event network-changed:3f832667-173e-45d5-bdc2-2c4340f882ab for instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 on hv-cinder-85103 Jul 26 15:40:21.892233 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-4489b31d-d899-4168-995a-32c397c3e195 req-4ee53b9f-673e-4f6d-9f85-03a3192b57f1 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034419 Jul 26 15:40:21.893456 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 390/867] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:22.267268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:22.267882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:22.274563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.278948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.278948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.278948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.418283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:22.426613 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1c11ac45-55ce-47d9-a474-39247dd611fa tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1454 microversion: 2.1 time: 0.163550 Jul 26 15:40:22.427190 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 478/868] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:22 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:22.454896 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:22.455516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:22.462157 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.463460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.464540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.464976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.555798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:22.556780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:22.563373 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.563824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.564707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:22.565146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:22.624651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:22.637214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9cc48460-0209-40ee-a4f7-e31b49e4d930 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1454 microversion: 2.1 time: 0.187009 Jul 26 15:40:22.637800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 391/869] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:22 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:22.708364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:22.724789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2af255ae-2745-4263-9591-37f7dae35970 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.165309 Jul 26 15:40:22.724789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 479/870] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:22 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:23.054453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1205054619"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:23.054987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:23.061754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.062329 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.062934 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.063358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.216314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.network.security_group_api [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Adding security group 0a707b5c-38d1-45a4-83e5-2d06dbf68a35 to port 74435adb-9de7-4203-96da-1b7dc6de5828 Jul 26 15:40:23.659426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:40:23.660006 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action (ip 10.222.0.128) !!! Jul 26 15:40:23.673401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6fb7f94d-18c3-4cef-b1a6-18b83f508402 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action" status: 202 len: 0 microversion: 2.1 time: 0.622750 Jul 26 15:40:23.674278 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 392/871] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:40:23 2022] POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:40:23.687214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:23.690566 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-a8ab3509-0db0-484e-a5b7-6873be2dcaac req-b30e4f47-49b2-4be1-93db-ccf6ec5d7173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:23.693319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:23.708230 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.708757 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.710330 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.713023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.716831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-a8ab3509-0db0-484e-a5b7-6873be2dcaac req-b30e4f47-49b2-4be1-93db-ccf6ec5d7173 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.717288 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-a8ab3509-0db0-484e-a5b7-6873be2dcaac req-b30e4f47-49b2-4be1-93db-ccf6ec5d7173 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.746550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-a8ab3509-0db0-484e-a5b7-6873be2dcaac req-b30e4f47-49b2-4be1-93db-ccf6ec5d7173 service nova] Creating event network-changed:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:40:23.754392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-a8ab3509-0db0-484e-a5b7-6873be2dcaac req-b30e4f47-49b2-4be1-93db-ccf6ec5d7173 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069981 Jul 26 15:40:23.755284 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 393/872] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:40:23.766623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:23.767848 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:23.781786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.781786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.781786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.781786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:24.001829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:24.011974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0409ab8c-6e3b-42c6-83e8-ca6c18f73a7b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.253270 Jul 26 15:40:24.013586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 394/873] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:23 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:24.158561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:24.174244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9a3359fb-140c-45c5-9ad4-7f57da64e9b3 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1764 microversion: 2.1 time: 0.495337 Jul 26 15:40:24.196648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 480/874] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:23 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1764 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:25.166724 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:25.167386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:25.174255 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.174708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.175506 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.175947 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.333905 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:25.342230 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-db3b4cd4-791d-4d62-9873-04a23d6f6772 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.310676 Jul 26 15:40:25.342840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 395/875] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:25 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:25.488203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:25.490558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:25.497423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.497868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.498645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.499084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.501933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:25.625969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-fce8ac50-68d5-409f-beee-43cd219cf04a req-509de348-6f51-4447-8b04-94fd89ab9607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f4641a-1f7d-473c-a239-03183b2ef9b9", "tag": "1bad2d35-9248-4aed-a7c2-1faaec7a1161"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:25.637834 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-fce8ac50-68d5-409f-beee-43cd219cf04a req-509de348-6f51-4447-8b04-94fd89ab9607 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.638282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-fce8ac50-68d5-409f-beee-43cd219cf04a req-509de348-6f51-4447-8b04-94fd89ab9607 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.650848 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-fce8ac50-68d5-409f-beee-43cd219cf04a req-509de348-6f51-4447-8b04-94fd89ab9607 service nova] Creating event network-changed:1bad2d35-9248-4aed-a7c2-1faaec7a1161 for instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 on hv-cinder-85103 Jul 26 15:40:25.656254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-fce8ac50-68d5-409f-beee-43cd219cf04a req-509de348-6f51-4447-8b04-94fd89ab9607 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035476 Jul 26 15:40:25.657131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 396/876] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:40:25.708041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=12 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:25.710092 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cecd93d2-4b50-44ef-bbfe-fb9549d6f4b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action" status: 202 len: 0 microversion: 2.1 time: 0.225703 Jul 26 15:40:25.715050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 481/877] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:40:25 2022] POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:40:25.720747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:25.722798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:25.727101 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:25.729714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.730545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.731581 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:25.732127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:25.949759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:25.959299 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-92462710-1749-4be6-aa66-4e6cdc7bfac2 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1756 microversion: 2.1 time: 0.242501 Jul 26 15:40:25.961080 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 397/878] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:25 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:26.366047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:26.366758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:26.378341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:26.381231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:26.381231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:26.381231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:26.559813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:26.566731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1aff02a3-a29f-499c-86fb-2f6e990b3e98 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.205915 Jul 26 15:40:26.567407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 482/879] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:26 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:26.983819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:26.984424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:26.990962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:26.991402 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:26.992154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:26.992637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:27.137721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:27.145701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3f740788-6532-40b8-8563-a17dbc4b2fdf tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.165732 Jul 26 15:40:27.146263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 398/880] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:26 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:27.587498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:27.588109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:27.594645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:27.595089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:27.595851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:27.596286 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:27.728870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:27.736274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f14706d4-c9a5-46af-b4c4-ad92a4e899f7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.152899 Jul 26 15:40:27.736923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 483/881] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:27 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:28.168633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:28.169239 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:28.175869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:28.176390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:28.177178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:28.177605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:28.298591 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-6ddf0203-fc1e-4848-932e-a42339c1b7b4 req-21ddedcd-9ecf-4972-b95b-89c79523f245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81603c0d-50b8-4ca7-8487-8063b5ec69e7", "name": "network-vif-plugged", "status": "completed", "tag": "3f832667-173e-45d5-bdc2-2c4340f882ab"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:28.309962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6ddf0203-fc1e-4848-932e-a42339c1b7b4 req-21ddedcd-9ecf-4972-b95b-89c79523f245 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:28.310505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6ddf0203-fc1e-4848-932e-a42339c1b7b4 req-21ddedcd-9ecf-4972-b95b-89c79523f245 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:28.321874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-6ddf0203-fc1e-4848-932e-a42339c1b7b4 req-21ddedcd-9ecf-4972-b95b-89c79523f245 service nova] Creating event network-vif-plugged:3f832667-173e-45d5-bdc2-2c4340f882ab for instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 on hv-cinder-85103 Jul 26 15:40:28.327843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-6ddf0203-fc1e-4848-932e-a42339c1b7b4 req-21ddedcd-9ecf-4972-b95b-89c79523f245 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Jul 26 15:40:28.328599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 484/882] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:28.336325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:28.349959 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-93d62d40-0ac3-48e1-a717-07cf4cedece0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.185825 Jul 26 15:40:28.351105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 399/883] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:28 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:28.759048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:28.760559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:28.767184 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:28.767633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:28.768402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:28.768867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:28.905425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:28.913252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8f3d38c-2c81-4728-8e3b-f3a04f9f7f1d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.158825 Jul 26 15:40:28.918368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 485/884] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:28 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:29.372370 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:29.373004 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:29.379735 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:29.380030 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:29.380862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:29.381300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:29.531021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:29.539068 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cc611c99-b867-412c-9f15-6b01e6b2d042 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.171376 Jul 26 15:40:29.539637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 400/885] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:29 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:29.934840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:29.935519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:29.942025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:29.944675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:29.944675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:29.944675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:30.077821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:30.085383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f2b5666c-86a6-49f3-b827-88b30ff606b1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1370 microversion: 2.1 time: 0.155223 Jul 26 15:40:30.085948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 486/886] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:29 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:30.562476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:30.563086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:30.569597 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:30.570031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:30.570817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:30.571247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:30.591034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:30.718627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:30.726625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6b0bbd68-6b7a-4276-9fdd-00fac5232532 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.168415 Jul 26 15:40:30.727231 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 401/887] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:30 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:31.106734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:31.107336 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:31.113633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.114083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.114840 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.115273 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.245226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:31.252931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4739f7c7-d1ab-4179-aded-d1b3d64d7ff2 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1557 microversion: 2.1 time: 0.150912 Jul 26 15:40:31.253496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 487/888] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:31 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:31.273890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:31.274379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:31.281189 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.281633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.282384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.282819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.362264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-67cf027d-9f9d-4bf1-b817-36981f2f00bc tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092379 Jul 26 15:40:31.362882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 402/889] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:40:31 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:31.749603 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:31.750216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:31.756271 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.756758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.757532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:31.757971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:31.907718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:31.916004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eaf43ae0-3e5d-4cf2-b1dd-468c2879113c tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.170140 Jul 26 15:40:31.925700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 488/890] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:31 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:32.372503 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-87212a68-f556-4ecd-a7e2-7edd13a93185 req-f71a833b-78bd-4a0a-9c34-abb51aaf3588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81603c0d-50b8-4ca7-8487-8063b5ec69e7", "tag": "3f832667-173e-45d5-bdc2-2c4340f882ab"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:32.383085 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-87212a68-f556-4ecd-a7e2-7edd13a93185 req-f71a833b-78bd-4a0a-9c34-abb51aaf3588 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:32.383528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-87212a68-f556-4ecd-a7e2-7edd13a93185 req-f71a833b-78bd-4a0a-9c34-abb51aaf3588 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:32.396543 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-87212a68-f556-4ecd-a7e2-7edd13a93185 req-f71a833b-78bd-4a0a-9c34-abb51aaf3588 service nova] Creating event network-changed:3f832667-173e-45d5-bdc2-2c4340f882ab for instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 on hv-cinder-85103 Jul 26 15:40:32.403099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-87212a68-f556-4ecd-a7e2-7edd13a93185 req-f71a833b-78bd-4a0a-9c34-abb51aaf3588 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034773 Jul 26 15:40:32.404014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 403/891] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:40:32.937715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:32.938497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:32.945258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:32.946161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:32.946634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:32.947650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:33.103585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:33.112404 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4fd34d3a-fd74-4124-a4d7-772c78ff9c17 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.178787 Jul 26 15:40:33.113187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 489/892] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:32 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:34.135941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:34.136806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:34.142752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:34.143199 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:34.143954 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:34.144387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:34.295373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:34.303465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7d14e2a2-6d7b-49d8-8e99-9190dd017150 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.172689 Jul 26 15:40:34.304148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 404/893] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:34 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:35.326926 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:35.327532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:35.334102 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:35.334543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:35.335306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:35.335756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:35.481718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:35.489741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-70254ffe-7984-4b4e-9acd-f45a18fe0547 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.167629 Jul 26 15:40:35.490302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 490/894] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:35 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:36.511162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:36.511805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:36.518442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:36.518886 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:36.519687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:36.520124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:36.677082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:36.686209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-20722c93-50cf-47a9-83ae-35fb527eec38 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.178792 Jul 26 15:40:36.686779 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 405/895] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:36 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:37.708937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:37.709541 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:37.716931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:37.717288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:37.718074 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:37.718507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:37.866061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:37.874771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02ff596d-8110-4da9-82df-6dbd4f579962 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.169670 Jul 26 15:40:37.875340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 491/896] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:37 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:38.897031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:38.897632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:38.904156 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:38.904633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:38.905386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:38.905814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:39.049618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:39.057725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5981e450-cd4b-4c7e-92b6-5047d081182e tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.164550 Jul 26 15:40:39.058569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 406/897] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:38 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:40.080180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:40.080761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:40.087240 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:40.087687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:40.088448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:40.088987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:40.232073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:40.241571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6cc74f53-8e6c-4b47-b942-e72f43fe6f51 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.165372 Jul 26 15:40:40.242134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 492/898] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:40 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:41.263247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:41.263876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:41.270299 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:41.270735 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:41.271487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:41.271916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:41.432239 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:41.440910 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2a51cfc5-cf5d-4b3e-be30-cd839085a87f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.181482 Jul 26 15:40:41.441493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 407/899] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:41 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:42.462667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:42.463388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:42.470634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:42.471111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:42.471854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:42.472287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:42.618086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:42.620363 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:42.626666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4e8fefde-da77-437b-8a1e-708de9d98cad tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.167920 Jul 26 15:40:42.631412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 493/900] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:42 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:43.649338 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:43.649958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:43.656484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:43.656939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:43.657693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:43.658149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:43.800153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:43.809324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f61021c0-83af-4a33-8cd3-ec32778828d7 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.164528 Jul 26 15:40:43.809938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 408/901] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:43 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:44.832585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:44.833248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:44.840053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:44.840533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:44.841311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:44.841750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:44.993214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:45.001598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ecfeff70-4cbd-4653-9324-6e851427564f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.173856 Jul 26 15:40:45.002166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 494/902] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:44 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:46.024048 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:46.024591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:46.031050 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:46.031507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:46.032245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:46.032698 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:46.182853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:46.190906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2f10ae03-cd15-4a47-a6db-b93c0ec49093 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.171382 Jul 26 15:40:46.191471 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 409/903] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:46 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:47.213994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:47.214763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:47.221198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:47.221649 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:47.222416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:47.222853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:47.365450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:47.373446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a5f67ffd-2993-493a-bfcc-30241175766a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.163292 Jul 26 15:40:47.374012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 495/904] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:47 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:48.396076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:48.396945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:48.403284 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:48.403766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:48.404749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:48.405325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:48.558342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:48.566204 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-02c0cb2b-a128-4f66-98a4-47904149d16a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.174785 Jul 26 15:40:48.566772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 410/905] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:48 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:49.588637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:49.589284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:49.591702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=52 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:49.597063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:49.600887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:49.600887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:49.600887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:49.757440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:49.765469 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-439481ab-cec6-480c-a215-a49af0959a42 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.180680 Jul 26 15:40:49.766047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 496/906] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:49 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:50.786859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:50.787393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:50.793918 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:50.794357 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:50.795112 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:50.795541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:50.938232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:50.946963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-739ce177-6292-46fe-99a2-7cef1cfe3167 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.164138 Jul 26 15:40:50.947535 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 411/907] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:50 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:51.968429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:51.969073 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:51.976045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:51.976505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:51.977265 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:51.977703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:52.118655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:52.126511 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9356bb66-4667-4cb7-8874-6d493e63894d tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1761 microversion: 2.1 time: 0.161896 Jul 26 15:40:52.127070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 497/908] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:51 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:53.148823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:53.149501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:53.156302 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:53.156773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:53.157536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:53.157964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:53.327717 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:53.336397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8896352f-f4c9-4a1f-907f-5820a6f29e49 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1764 microversion: 2.1 time: 0.191712 Jul 26 15:40:53.337143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 412/909] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:40:53 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1764 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:59.362636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:59.363137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:59.370115 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.370557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.371313 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.371743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.400958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e35fbc1b-33ae-4ae9-9c66-b12157850647 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments/211707e0-b324-496f-a821-e7d5d1cfbc50" status: 200 len: 194 microversion: 2.20 time: 0.148497 Jul 26 15:40:59.401536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 498/910] 10.222.0.128 () {60 vars in 1459 bytes} [Tue Jul 26 15:40:59 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments/211707e0-b324-496f-a821-e7d5d1cfbc50 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:40:59.469375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:59.469868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:59.472377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=31 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:59.479403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.479843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.480840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.481396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.566218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lazy-loading 'services' on Instance uuid 466faeda-8564-46cd-a893-141a3ed7e409 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:40:59.737991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2854cbe6-d70c-4efa-a5c7-8f0b346d2395 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments/211707e0-b324-496f-a821-e7d5d1cfbc50" status: 202 len: 0 microversion: 2.20 time: 0.272321 Jul 26 15:40:59.738706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 413/911] 10.222.0.128 () {60 vars in 1462 bytes} [Tue Jul 26 15:40:59 2022] DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments/211707e0-b324-496f-a821-e7d5d1cfbc50 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:40:59.754068 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:59.758423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:59.764717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.765105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.765916 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:59.766452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:59.797821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-be456d56-144c-4560-9294-f7402f333263 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054265 Jul 26 15:40:59.798381 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 499/912] 10.222.0.128 () {60 vars in 1348 bytes} [Tue Jul 26 15:40:59 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:41:00.813049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:00.815392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:00.822256 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:00.822697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:00.823464 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:00.823893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:00.827800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:00.857771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0e1e7d85-6bd1-4f11-9e54-5d780b83f252 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049607 Jul 26 15:41:00.858933 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 414/913] 10.222.0.128 () {60 vars in 1348 bytes} [Tue Jul 26 15:41:00 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:41:01.871464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:01.874576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:01.879732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:01.880182 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:01.881629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:01.882103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:01.910453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-894446c9-118b-4c38-8a1c-49432c7ace6e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043704 Jul 26 15:41:01.911001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 500/914] 10.222.0.128 () {60 vars in 1348 bytes} [Tue Jul 26 15:41:01 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:01.981230 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:01.981801 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:01.988576 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:01.989023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:01.990297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:01.990732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:02.018347 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:02.445473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cbcdc9ac-9d9f-44c6-82ec-6ef1b5d9f6d0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 204 len: 0 microversion: 2.20 time: 0.468305 Jul 26 15:41:02.446018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 415/915] 10.222.0.128 () {60 vars in 1285 bytes} [Tue Jul 26 15:41:01 2022] DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:41:02.454708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:02.458290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:02.462636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:02.463119 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:02.463935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:02.464610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:02.612755 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:02.621782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:02.623275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:02.624406 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce201bb6-c453-43a1-bbc2-105fff8df041 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.173875 Jul 26 15:41:02.625000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 501/916] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:02 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:03.649686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:03.650386 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:03.660388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:03.660875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:03.661701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:03.662162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:03.809747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:03.817733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:03.819772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:03.821065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f02d7ee3-0cb7-4c9f-9073-a7fe897a00b0 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.176378 Jul 26 15:41:03.821619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 416/917] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:03 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:04.846408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:04.846951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:04.854441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:04.854981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:04.859830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:04.859830 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:05.004874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:05.014315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:05.015818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:05.017026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8f106750-b683-4816-8e64-8f4520f2a76e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1727 microversion: 2.20 time: 0.175198 Jul 26 15:41:05.017590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 502/918] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:04 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:05.349183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:05.349955 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:05.357525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:05.362219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:05.363197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:05.363652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:05.475517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'services' on Instance uuid e1394b46-b21c-48f5-96e4-881de63f22c2 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:05.650683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3d2fe2a2-7812-4c21-b5a7-2a6dfc2ccd93 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments/ec2e11e9-8a1f-416a-a579-08bd266c67dc" status: 202 len: 0 microversion: 2.1 time: 0.305823 Jul 26 15:41:05.651912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 417/919] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:41:05 2022] DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments/ec2e11e9-8a1f-416a-a579-08bd266c67dc => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:05.662598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:05.665617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:05.674852 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:05.678631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:05.678631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:05.678631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:05.710475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0dcd77cd-f874-415b-b94a-fdc9b24f797f tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053428 Jul 26 15:41:05.712718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 503/920] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:05 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:06.043039 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:06.043753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:06.051047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:06.051499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:06.052985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:06.053422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:06.333613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:06.342895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:06.344424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:06.346659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-250b107c-db4a-4d41-bc4a-d3d001034be7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1660 microversion: 2.20 time: 0.310251 Jul 26 15:41:06.347229 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 418/921] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:06 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1660 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:06.597202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-33097d27-1abb-4d8b-ae84-cb58b16a5366 req-29a78cd0-dcb7-4b36-927c-535177fd74bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466faeda-8564-46cd-a893-141a3ed7e409", "name": "network-vif-deleted", "tag": "86c0b00c-84f0-4079-9990-7a8a967d7342"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:06.610702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-33097d27-1abb-4d8b-ae84-cb58b16a5366 req-29a78cd0-dcb7-4b36-927c-535177fd74bd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:06.610702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-33097d27-1abb-4d8b-ae84-cb58b16a5366 req-29a78cd0-dcb7-4b36-927c-535177fd74bd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:06.621659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-33097d27-1abb-4d8b-ae84-cb58b16a5366 req-29a78cd0-dcb7-4b36-927c-535177fd74bd service nova] Creating event network-vif-deleted:86c0b00c-84f0-4079-9990-7a8a967d7342 for instance 466faeda-8564-46cd-a893-141a3ed7e409 on hv-cinder-85103 Jul 26 15:41:06.626854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-33097d27-1abb-4d8b-ae84-cb58b16a5366 req-29a78cd0-dcb7-4b36-927c-535177fd74bd service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095610 Jul 26 15:41:06.627693 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 504/922] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:06.723542 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:06.725843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:06.734463 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:06.735870 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:06.736237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:06.736781 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:06.774165 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1c0cbaab-9163-410f-ba22-361c256afcc6 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054586 Jul 26 15:41:06.779732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 419/923] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:06 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:07.371124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:07.371779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:07.379809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.380314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.381163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.381583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.415476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.415926 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.416385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lazy-loading 'fault' on Instance uuid 466faeda-8564-46cd-a893-141a3ed7e409 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:07.461721 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:07.470573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:07.474515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:07.474515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a0ab325-8b39-4960-8dec-a9417f75a681 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 200 len: 1376 microversion: 2.20 time: 0.106486 Jul 26 15:41:07.474515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 505/924] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:07 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 1376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:41:07.786458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:07.789702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:07.796143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.796662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.797421 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.797856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.829186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d787da6e-9e4f-455d-94eb-2941d7c7062c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046741 Jul 26 15:41:07.829725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 420/925] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:07 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:41:07.923919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:07.924508 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:07.932333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.932946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.933755 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:07.934322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:07.960234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:08.221522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27c03521-d6ad-4643-9452-5b83ae401383 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 204 len: 0 microversion: 2.1 time: 0.301189 Jul 26 15:41:08.222124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 506/926] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:07 2022] DELETE /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:41:08.230921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:08.231539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:08.237594 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:08.238194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:08.238964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:08.239403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:08.375361 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:08.383673 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-fec3e087-25d5-4b74-9a35-e11f5deeabea tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1693 microversion: 2.1 time: 0.156626 Jul 26 15:41:08.384242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 421/927] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:08 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:08.497640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:08.498251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:08.504235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:08.504778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:08.506167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:08.506600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:08.519640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 HTTP/1.1 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:41:08.521375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:41:08.523215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '466faeda-8564-46cd-a893-141a3ed7e409'} Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:08.524536 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:41:08.526164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:08.527472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:08.527472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-da0884b2-c693-47d4-aeb4-b8f1f13b8415 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 404 len: 111 microversion: 2.20 time: 0.029351 Jul 26 15:41:08.527472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 507/928] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:08 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:41:08.531877 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d808652a-f127-4dd3-ad5c-4fc59c8c6d22 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '.version_select at 0x7f346ab4aee0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:08.588101 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d808652a-f127-4dd3-ad5c-4fc59c8c6d22 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653637068" status: 204 len: 0 microversion: 2.20 time: 0.060066 Jul 26 15:41:08.588714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 422/929] 10.222.0.128 () {60 vars in 1267 bytes} [Tue Jul 26 15:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653637068 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:41:09.327389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2e7fd4dd-1df4-4276-9f5b-97e5f5a0c8a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: .version_select at 0x7f34733b0430>, body: {"keypair": {"name": "tempest-keypair-1126455409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy0Qgag8UBeqkE2y0FpETHcERQpVPb6Bnta6gXal7ADwAcnE3wm7HkGUB2o2kd8J4OukMS65kO43DlbCnsg8P9StV34MXX0jSdGfDZoO/iAszn2OIU8xtZadgDarStj5w=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:09.344128 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-2e7fd4dd-1df4-4276-9f5b-97e5f5a0c8a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for project 1165baf67df0484dbe4163c5a750784a. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:09.348307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-2e7fd4dd-1df4-4276-9f5b-97e5f5a0c8a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for user e2e9553297c842b3a3c308cdd09aad8d and project 1165baf67df0484dbe4163c5a750784a. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:09.406008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2e7fd4dd-1df4-4276-9f5b-97e5f5a0c8a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.082428 Jul 26 15:41:09.406588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:09.407112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 508/930] 10.222.0.128 () {62 vars in 1205 bytes} [Tue Jul 26 15:41:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:41:09.407211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:09.414986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:09.416218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:09.416333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:09.416829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:09.554151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:09.562305 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1d9868ad-d404-4753-a2db-95bb6c3bda08 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1693 microversion: 2.1 time: 0.159997 Jul 26 15:41:09.562879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 423/931] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:09 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:10.584123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:10.584895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:10.593174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:10.593729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:10.594506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:10.594945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:10.802862 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:10.811672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-38218365-0ee0-4574-b790-0f7edc4d4805 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1693 microversion: 2.1 time: 0.232180 Jul 26 15:41:10.812242 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 509/932] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:10 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:11.631785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-595150466", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8f586bd-fa08-43ea-8187-a7c90e05c8af"}], "security_groups": [{"name": "tempest-securitygroup--1602222843"}], "key_name": "tempest-keypair-1126455409", "user_data": "}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:11.736235 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] validate_networks() for [('c8f586bd-fa08-43ea-8187-a7c90e05c8af', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:41:11.834033 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:11.842670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:11.842670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:11.842670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:11.843007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:11.843252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:11.991703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:11.994098 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:12.000298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f9260f7a-ef08-4e37-87fa-5fc70b54aced tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1693 microversion: 2.1 time: 0.170186 Jul 26 15:41:12.000974 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 510/933] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:11 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:12.159969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:41:12.160487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:41:12.160965 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:41:12.161367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:41:12.161768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:41:12.171281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:12.171721 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:12.172536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:12.172967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:12.189894 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for project 1165baf67df0484dbe4163c5a750784a. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:12.193629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Getting quotas for user e2e9553297c842b3a3c308cdd09aad8d and project 1165baf67df0484dbe4163c5a750784a. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:12.204204 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:41:12.206481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:41:12.337626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-21555e74-c8b9-41f2-8b0a-a468662fec82 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.710377 Jul 26 15:41:12.338465 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 424/934] 10.222.0.128 () {62 vars in 1193 bytes} [Tue Jul 26 15:41:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 15:41:12.349306 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:12.354842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:12.408216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:12.416822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:12.418357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:12.420510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc81b567-f725-4abb-92bf-e1658072e21b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1285 microversion: 2.20 time: 0.074236 Jul 26 15:41:12.420510 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 511/935] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:12 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1285 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:41:13.028516 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:13.029167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:13.036371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:13.039095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:13.039095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:13.039095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:13.279731 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:13.290137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-59ef9ab9-e379-45df-8c76-c7b389a028df tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1693 microversion: 2.1 time: 0.266358 Jul 26 15:41:13.296299 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 425/936] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:13 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1693 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:13.442897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:13.444238 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:13.624204 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:13.625025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:13.626100 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:13.626751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:13.698793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:13.707419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:13.708917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:13.710564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5433eb84-5e3f-4365-86a1-37ae3b84e476 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1281 microversion: 2.20 time: 0.271439 Jul 26 15:41:13.711310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 512/937] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:13 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1281 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:14.126315 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-82983880-53c7-4d0d-831b-292d4b72cdba req-7ec6efcb-b166-475b-9ec7-93c46398f648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1394b46-b21c-48f5-96e4-881de63f22c2", "name": "network-vif-deleted", "tag": "96c23394-f6f0-4c0f-a661-af48811510a4"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:14.139243 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-82983880-53c7-4d0d-831b-292d4b72cdba req-7ec6efcb-b166-475b-9ec7-93c46398f648 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:14.139693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-82983880-53c7-4d0d-831b-292d4b72cdba req-7ec6efcb-b166-475b-9ec7-93c46398f648 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:14.151751 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-82983880-53c7-4d0d-831b-292d4b72cdba req-7ec6efcb-b166-475b-9ec7-93c46398f648 service nova] Creating event network-vif-deleted:96c23394-f6f0-4c0f-a661-af48811510a4 for instance e1394b46-b21c-48f5-96e4-881de63f22c2 on hv-cinder-85103 Jul 26 15:41:14.156869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-82983880-53c7-4d0d-831b-292d4b72cdba req-7ec6efcb-b166-475b-9ec7-93c46398f648 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Jul 26 15:41:14.157559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 426/938] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:14.314516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:14.315441 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:14.325894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:14.325894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:14.326203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:14.326494 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:14.410008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:14.417856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fe53d68f-ad02-4013-a668-2fd23602e4b0 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1625 microversion: 2.1 time: 0.110046 Jul 26 15:41:14.418551 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 513/939] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:14 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1625 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:14.739404 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:14.740869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:14.754951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:14.758414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:14.758414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:14.769270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:14.888063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:14.896346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:14.901242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:14.901242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c398175d-db04-4c39-b9eb-1a9603bffcfc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1345 microversion: 2.20 time: 0.167183 Jul 26 15:41:14.901242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 427/940] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:14 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:15.441266 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:15.441977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:15.450594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:15.451034 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:15.451851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:15.452289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:15.488423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:15.495385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:15.495385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'fault' on Instance uuid e1394b46-b21c-48f5-96e4-881de63f22c2 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:15.531633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:15.541097 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f3904813-bd6f-4176-b64a-9f0e0aa59402 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 200 len: 1339 microversion: 2.1 time: 0.105260 Jul 26 15:41:15.541968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 514/941] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:15 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:15.925323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:15.925950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:15.935251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:15.935708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:15.936530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:15.937009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:16.162056 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:16.171057 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:16.173148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:16.175726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f1517603-5d77-4142-b98d-064fb994cbf3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.253082 Jul 26 15:41:16.175726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 428/942] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:15 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:16.566382 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:16.567055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: e1394b46-b21c-48f5-96e4-881de63f22c2] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:16.573901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:16.574396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:16.575217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:16.575653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:16.600065 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] HTTP exception thrown: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Request method failure captured: Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 HTTP/1.1 Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am6GpGsOgmODNq_wbmCNv7IogT8hHP3CLk4Y6q8hnPGDFBZdj2sLjrVY5DnRevgzo7I3H2FPXCqZUcDYpR_pmziYfgRgguD1-cA1cEEE7eQK1MTx1PU_ajeeybBk5FKYBslmtnz7G7xJl5JOEPQOU6NIV9MTZSVn3HyDDEpa_o5yOw Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:41:16.602283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_cc117969e9394769a471d512ce80734a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/cc117969e9394769a471d512ce80734a"}]}] Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2bf7ea384a142d1bc23b23ab503fca0 Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. Jul 26 15:41:16.608530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'e1394b46-b21c-48f5-96e4-881de63f22c2'} Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:16.609446 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. Jul 26 15:41:16.610871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:16.612186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Returning 404 to user: Instance e1394b46-b21c-48f5-96e4-881de63f22c2 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:16.612186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2180947a-45bf-49e1-b859-c8086404034c tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2" status: 404 len: 111 microversion: 2.1 time: 0.041150 Jul 26 15:41:16.612186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 515/943] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:16 2022] GET /compute/v2.1/servers/e1394b46-b21c-48f5-96e4-881de63f22c2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:41:16.612445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2817d870-043e-4936-aa22-9694cc0501a4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '.version_select at 0x7f346a9440d0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:16.691381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2817d870-043e-4936-aa22-9694cc0501a4 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017805854" status: 202 len: 0 microversion: 2.1 time: 0.082735 Jul 26 15:41:16.692155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 429/944] 10.222.0.128 () {58 vars in 1226 bytes} [Tue Jul 26 15:41:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017805854 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:17.013954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-1e909ecc-999a-492d-9421-5b2b35fef122 req-79b42ee2-aae1-4318-8dcb-e80266daf837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:17.030987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1e909ecc-999a-492d-9421-5b2b35fef122 req-79b42ee2-aae1-4318-8dcb-e80266daf837 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:17.036651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1e909ecc-999a-492d-9421-5b2b35fef122 req-79b42ee2-aae1-4318-8dcb-e80266daf837 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:17.059664 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-1e909ecc-999a-492d-9421-5b2b35fef122 req-79b42ee2-aae1-4318-8dcb-e80266daf837 service nova] Creating event network-changed:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:41:17.065317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-1e909ecc-999a-492d-9421-5b2b35fef122 req-79b42ee2-aae1-4318-8dcb-e80266daf837 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056229 Jul 26 15:41:17.066244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 516/945] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:17.203958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:17.204762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:17.212021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:17.212773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:17.213595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:17.214034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:17.452817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:17.463103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:17.465046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:17.466208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-45c389fb-f42f-4b20-9baf-67bdcece9c69 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.266225 Jul 26 15:41:17.467113 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 430/946] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:17 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:18.490954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:18.491800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:18.498108 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:18.498554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:18.499353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:18.499788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:18.632735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:18.640897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:18.642412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:18.643533 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2ab5bdcc-b3ff-4a42-90b5-f41596648ad3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.157418 Jul 26 15:41:18.644080 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 517/947] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:18 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:19.631362 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:19.634042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:19.640738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.641190 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.641953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.642389 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.667039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:19.667578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:19.668201 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:19.670039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:19.672425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7463d001-eff5-462d-ad10-31abd2870975 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045071 Jul 26 15:41:19.673225 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 431/948] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:19 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:41:19.678921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.679779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.681200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.681629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.737704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:19.738200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:19.745789 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.746379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.747173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:19.747646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:19.774578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:19.823848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:19.831834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:19.833448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:19.835084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9b229d10-b317-4315-aa2b-b15d5ff3ba30 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.172193 Jul 26 15:41:19.835745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 518/949] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:19 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:41:20.045944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:20.046495 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:20.052839 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.053988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.055012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.055709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.080557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:20.107025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-de81ddae-192d-4334-b27a-e2a1076aa234 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 204 len: 0 microversion: 2.1 time: 0.373268 Jul 26 15:41:20.107683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 432/950] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:19 2022] DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:41:20.118274 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:20.119017 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:20.124989 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.125442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.126213 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.126650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.264150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:20.271821 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d928f37f-71f1-4f84-ba5b-dd7c1a81299b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1676 microversion: 2.1 time: 0.158507 Jul 26 15:41:20.272348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 433/951] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:20 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:20.374679 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad996202-891a-4bd4-bfc5-a03a8338ffdd tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 204 len: 0 microversion: 2.1 time: 0.332228 Jul 26 15:41:20.375340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 519/952] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:20 2022] DELETE /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:41:20.384082 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:20.385023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:20.391157 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.391606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.392375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.392837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.528200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:20.535661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2c4d506d-796f-45d2-8330-b54765b0dd31 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1512 microversion: 2.1 time: 0.155802 Jul 26 15:41:20.536229 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 434/953] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:20 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:20.858333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:20.858934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:20.865506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.866565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:20.867710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:20.868142 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:21.002726 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:21.012332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:21.013860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:21.014967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a823fd5c-b5da-40a2-9871-a50f2991e92c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.161275 Jul 26 15:41:21.015589 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 520/954] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:20 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:21.293387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:21.294178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:21.300629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:21.304481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:21.304481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:21.304481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:21.438172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:21.445709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8b253075-bcfc-42c9-9e53-2ac3e7bbef9f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1676 microversion: 2.1 time: 0.156064 Jul 26 15:41:21.446373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 435/955] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:21 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:21.557427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:21.558060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:21.565008 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:21.565457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:21.566222 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:21.566654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:21.694792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:21.702226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b3275977-331c-426a-8683-445a6299e981 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1512 microversion: 2.1 time: 0.149016 Jul 26 15:41:21.702784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 521/956] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:21 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:22.038379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:22.039195 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:22.045196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.045636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.046390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.046826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.179262 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:22.181956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:22.188376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:22.190295 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:22.196542 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8243cbb3-f762-4eb6-93ff-6dc5cd5e4be1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.157095 Jul 26 15:41:22.196542 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 436/957] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:22 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:22.467475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:22.468031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:22.470630 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:22.473541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=6 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:22.476706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.477255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.479457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.479988 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.535633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-1807f708-0940-4a88-87ca-bb26ef5c5cc0 req-70f09b63-4f6d-4246-834b-5d4bf0cb4da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "name": "network-vif-plugged", "status": "completed", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:22.546514 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-1807f708-0940-4a88-87ca-bb26ef5c5cc0 req-70f09b63-4f6d-4246-834b-5d4bf0cb4da3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.546985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-1807f708-0940-4a88-87ca-bb26ef5c5cc0 req-70f09b63-4f6d-4246-834b-5d4bf0cb4da3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.561275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-1807f708-0940-4a88-87ca-bb26ef5c5cc0 req-70f09b63-4f6d-4246-834b-5d4bf0cb4da3 service nova] Creating event network-vif-plugged:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:41:22.566575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-1807f708-0940-4a88-87ca-bb26ef5c5cc0 req-70f09b63-4f6d-4246-834b-5d4bf0cb4da3 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097008 Jul 26 15:41:22.567481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 437/958] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:41:22.618640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:22.626169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6109c382-8433-4c81-8ad3-70111797cd2e tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1676 microversion: 2.1 time: 0.162965 Jul 26 15:41:22.626718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 522/959] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:22 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:22.724210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:22.725131 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:22.733718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.734169 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.734993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:22.735802 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:22.953435 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:22.970166 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7442047f-12ae-4359-b14b-b0fe205500c3 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1512 microversion: 2.1 time: 0.250504 Jul 26 15:41:22.970756 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 438/960] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:22 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:23.214978 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:23.216393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:23.222962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:23.223414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:23.224353 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:23.224894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:23.427541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-2496bb3d-73ff-40f1-8679-4cb90a546b9e req-8025d6ad-aaec-4acd-a68b-fe4f6921d061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094531b2-332c-4227-9a35-69a4b7cec6ce", "name": "network-vif-deleted", "tag": "a7399383-25ce-46f7-8438-c79ed3f59c27"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:23.435878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:23.438747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2496bb3d-73ff-40f1-8679-4cb90a546b9e req-8025d6ad-aaec-4acd-a68b-fe4f6921d061 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:23.439197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2496bb3d-73ff-40f1-8679-4cb90a546b9e req-8025d6ad-aaec-4acd-a68b-fe4f6921d061 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:23.443690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:23.446103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:23.447394 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f7e1d774-f5b0-4ada-8466-5c6b0de4881a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.236304 Jul 26 15:41:23.448241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 523/961] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:23 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:41:23.456712 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-2496bb3d-73ff-40f1-8679-4cb90a546b9e req-8025d6ad-aaec-4acd-a68b-fe4f6921d061 service nova] Creating event network-vif-deleted:a7399383-25ce-46f7-8438-c79ed3f59c27 for instance 094531b2-332c-4227-9a35-69a4b7cec6ce on hv-cinder-85103 Jul 26 15:41:23.465120 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-2496bb3d-73ff-40f1-8679-4cb90a546b9e req-8025d6ad-aaec-4acd-a68b-fe4f6921d061 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125889 Jul 26 15:41:23.466089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 439/962] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:23.650212 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:23.650877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:23.658313 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:23.658717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:23.659732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:23.660618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:23.735969 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:23.745768 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-365410bc-7a84-44c8-9feb-7afae5e90669 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1608 microversion: 2.1 time: 0.102100 Jul 26 15:41:23.746354 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 524/963] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:23 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1608 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:23.993154 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:23.994454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:24.001032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.001479 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.002253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.002718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.113580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:24.122434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-06819512-8363-4b87-a850-758253a9144d tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1297 microversion: 2.1 time: 0.134838 Jul 26 15:41:24.123019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 440/964] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:23 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:24.196834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-bed56ceb-0b53-4e15-87bf-1c308cacb903 req-fbc3a404-ba01-4806-96ba-ba12bbf263e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f25fe8-dfd0-4c65-bb2d-a5dd15567b85", "name": "network-vif-deleted", "tag": "c2d8a054-3dab-4928-969a-c1b58ea17b2a"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:24.207709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-bed56ceb-0b53-4e15-87bf-1c308cacb903 req-fbc3a404-ba01-4806-96ba-ba12bbf263e8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.208520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-bed56ceb-0b53-4e15-87bf-1c308cacb903 req-fbc3a404-ba01-4806-96ba-ba12bbf263e8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.221532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-bed56ceb-0b53-4e15-87bf-1c308cacb903 req-fbc3a404-ba01-4806-96ba-ba12bbf263e8 service nova] Creating event network-vif-deleted:c2d8a054-3dab-4928-969a-c1b58ea17b2a for instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 on hv-cinder-85103 Jul 26 15:41:24.226803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-bed56ceb-0b53-4e15-87bf-1c308cacb903 req-fbc3a404-ba01-4806-96ba-ba12bbf263e8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035261 Jul 26 15:41:24.227736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 525/965] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:24.470114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:24.470762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:24.477609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.478065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.478857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.479297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.624408 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:24.633739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:24.635317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:24.636497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-91b6142f-2dd8-48cd-a3c4-8fdf14e23154 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1411 microversion: 2.20 time: 0.170365 Jul 26 15:41:24.648487 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 441/966] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:24 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:24.769261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:24.769985 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:24.786577 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.786838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.787581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.788729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.823020 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:24.823469 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:24.823928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'fault' on Instance uuid 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:24.868528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:24.875991 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e3913177-f019-417e-8448-e8fdb531477b tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1330 microversion: 2.1 time: 0.111444 Jul 26 15:41:24.876576 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 526/967] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:24 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:25.144855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:25.145471 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:25.152129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.152617 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.153397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.153839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.186881 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.187335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.187784 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lazy-loading 'fault' on Instance uuid 094531b2-332c-4227-9a35-69a4b7cec6ce {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:25.235742 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:25.244413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d4cf39a7-0ee8-427f-95c6-efb61a887d47 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 200 len: 1316 microversion: 2.1 time: 0.103616 Jul 26 15:41:25.245033 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 442/968] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:25 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:25.659472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:25.659996 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:25.666346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.666800 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.667565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.668002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.801371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:25.810792 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:25.812300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:25.813484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-12ebf247-6dc3-4a2e-9a22-45074b3e5b3a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1602 microversion: 2.20 time: 0.158188 Jul 26 15:41:25.815698 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 527/969] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:41:25 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1602 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:41:25.838293 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:25.838791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:25.847908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.848592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.849392 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.849827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.903789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:25.904958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:25.915745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.916627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.919198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.919198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.927144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:25.954042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-127dea81-5505-4e38-98b2-108c375c9782 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119818 Jul 26 15:41:25.961425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 443/970] 10.222.0.128 () {60 vars in 1321 bytes} [Tue Jul 26 15:41:25 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:41:25.976560 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:25.977156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:25.977899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'fault' on Instance uuid 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:26.033179 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:26.041383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0753211d-9cc1-4518-b470-d468ecca4db7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 200 len: 1330 microversion: 2.1 time: 0.146617 Jul 26 15:41:26.041950 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 528/971] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:25 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 1330 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:26.267419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:26.268038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 094531b2-332c-4227-9a35-69a4b7cec6ce] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:26.274342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.274794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.275564 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.276005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.292651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] HTTP exception thrown: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Request method failure captured: Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce HTTP/1.1 Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am6GpGsOgmODNq_wbmCNv7IogT8hHP3CLk4Y6q8hnPGDFBZdj2sLjrVY5DnRevgzo7I3H2FPXCqZUcDYpR_pmziYfgRgguD1-cA1cEEE7eQK1MTx1PU_ajeeybBk5FKYBslmtnz7G7xJl5JOEPQOU6NIV9MTZSVn3HyDDEpa_o5yOw Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:26.294317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_cc117969e9394769a471d512ce80734a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/cc117969e9394769a471d512ce80734a"}]}] Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: c2bf7ea384a142d1bc23b23ab503fca0 Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. Jul 26 15:41:26.298263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '094531b2-332c-4227-9a35-69a4b7cec6ce'} Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:26.299167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. Jul 26 15:41:26.300560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:26.301876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Returning 404 to user: Instance 094531b2-332c-4227-9a35-69a4b7cec6ce could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:26.301876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e7942af0-c668-49f5-ae92-b7985c5cabca tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce" status: 404 len: 111 microversion: 2.1 time: 0.032835 Jul 26 15:41:26.301876 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 444/972] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:26 2022] GET /compute/v2.1/servers/094531b2-332c-4227-9a35-69a4b7cec6ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:41:26.309561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:26.310059 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:26.316965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.317419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.318195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.318635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.345539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:26.609456 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-019e9a4f-36f7-4b37-a571-7d2de612b098 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "DELETE /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 204 len: 0 microversion: 2.1 time: 0.305290 Jul 26 15:41:26.610075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 529/973] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:26 2022] DELETE /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:41:26.618636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:26.619261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:26.625538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.626232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.627208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:26.627651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:26.839932 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:26.847563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-55be4ba4-a4a7-4adc-96ae-bb4e6c78a4ed tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.233324 Jul 26 15:41:26.848129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 445/974] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:26 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:27.067943 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:27.070676 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:27.082823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:27.083637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:27.085309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:27.086112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:27.098434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-ea5919d9-333b-4463-9537-093d03c4186c req-89240c16-15ab-4027-b630-afde75e99813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:27.104072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 HTTP/1.1 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:41:27.105883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:41:27.107199 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '61f25fe8-dfd0-4c65-bb2d-a5dd15567b85'} Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:27.107947 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:41:27.109307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:41:27.110610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:27.110610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b4a8a39b-9f1a-4ee2-b09b-467c1b8001c6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 404 len: 111 microversion: 2.1 time: 0.047513 Jul 26 15:41:27.110765 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:27.110865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 530/975] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:27 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:41:27.119662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bf74ea81-1001-41de-8538-dfd5f1209eb0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '.version_select at 0x7f347340b430>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:27.123744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-ea5919d9-333b-4463-9537-093d03c4186c req-89240c16-15ab-4027-b630-afde75e99813 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:27.124575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-ea5919d9-333b-4463-9537-093d03c4186c req-89240c16-15ab-4027-b630-afde75e99813 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:27.148619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-ea5919d9-333b-4463-9537-093d03c4186c req-89240c16-15ab-4027-b630-afde75e99813 service nova] Creating event network-changed:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:41:27.157976 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-ea5919d9-333b-4463-9537-093d03c4186c req-89240c16-15ab-4027-b630-afde75e99813 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066482 Jul 26 15:41:27.159235 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 446/976] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:27.210454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bf74ea81-1001-41de-8538-dfd5f1209eb0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152246200" status: 202 len: 0 microversion: 2.1 time: 0.096116 Jul 26 15:41:27.211041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 531/977] 10.222.0.128 () {58 vars in 1223 bytes} [Tue Jul 26 15:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152246200 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:41:27.870536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:27.871894 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:27.880545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:27.881500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:27.882601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:27.883230 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:28.028373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:28.038808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-92c68fa7-d47e-4253-9050-1d82453fa530 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.172089 Jul 26 15:41:28.051145 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 447/978] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:27 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:28.250794 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ed8e9640-aeb5-47bb-8da2-41cb713cd787 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: .version_select at 0x7f3473435700>, body: {"keypair": {"name": "tempest-keypair-1361956165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2i6+WhEzo0uO4He6TUHLQ5DekAjP/cfZAapXUxmhaPY3YfLfzqRddhvJ/FGtRem0pHQZIhJS2v7Jp0liZFeJMwPZMcQo56nckCr+XRiV9iEwkKyMCSdQR9QxjeRofZaw=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:28.267710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-ed8e9640-aeb5-47bb-8da2-41cb713cd787 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for project f81499626e98449897622291738f07f7. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:28.271478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-ed8e9640-aeb5-47bb-8da2-41cb713cd787 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for user c2e3c15511fe433a9278248c528c86e0 and project f81499626e98449897622291738f07f7. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:28.354289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ed8e9640-aeb5-47bb-8da2-41cb713cd787 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107943 Jul 26 15:41:28.354892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 532/979] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:41:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:28.771683 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:28.772794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:28.778878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:28.779324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:28.780092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:28.780549 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:28.805509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4437213d-0e46-45c3-a2cd-e2af1c082874 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/ips" status: 200 len: 145 microversion: 2.1 time: 0.037527 Jul 26 15:41:28.806095 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 448/980] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:41:28 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:29.060940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:29.061547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:29.067735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:29.068184 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:29.069941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:29.070519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:29.232813 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:29.240418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f695f8da-3964-444a-834a-d85b763a5d98 tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1524 microversion: 2.1 time: 0.183712 Jul 26 15:41:29.241136 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 533/981] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:29 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1524 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:30.156979 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-bf5f5de5-ad3e-425d-aedf-1b40605b820c req-cbb0f59d-4cf9-4662-92dd-60cce323980f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f12547e-bcd6-45c7-afee-0e20f7929840", "name": "network-vif-deleted", "tag": "c03b7ef2-921a-46c7-a2cf-56b5e31aee6f"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:30.167774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bf5f5de5-ad3e-425d-aedf-1b40605b820c req-cbb0f59d-4cf9-4662-92dd-60cce323980f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:30.169700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bf5f5de5-ad3e-425d-aedf-1b40605b820c req-cbb0f59d-4cf9-4662-92dd-60cce323980f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:30.179532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-bf5f5de5-ad3e-425d-aedf-1b40605b820c req-cbb0f59d-4cf9-4662-92dd-60cce323980f service nova] Creating event network-vif-deleted:c03b7ef2-921a-46c7-a2cf-56b5e31aee6f for instance 0f12547e-bcd6-45c7-afee-0e20f7929840 on hv-cinder-85103 Jul 26 15:41:30.184804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-bf5f5de5-ad3e-425d-aedf-1b40605b820c req-cbb0f59d-4cf9-4662-92dd-60cce323980f service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031505 Jul 26 15:41:30.185907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 449/982] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:30.262692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:30.263339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:30.269798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:30.270250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:30.271025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:30.271471 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:30.337681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2bf7ea384a142d1bc23b23ab503fca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc117969e9394769a471d512ce80734a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:30.345280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-640db896-31dc-4e4b-aa60-18ebc93e0cbe tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 200 len: 1310 microversion: 2.1 time: 0.087108 Jul 26 15:41:30.345848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 534/983] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:30 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:30.442974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76d8f9d-27be-4671-8678-fff5246e4482"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:30.445853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:30.462143 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:30.462616 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:30.463506 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:30.463950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:30.487187 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:30.863932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2066807629", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e973f3b-c20c-47c1-ae4e-46f7a0f09a18"}], "security_groups": [{"name": "tempest-securitygroup--138793859"}], "key_name": "tempest-keypair-1361956165", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:30.971758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] validate_networks() for [('8e973f3b-c20c-47c1-ae4e-46f7a0f09a18', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:41:31.384575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9a1d77fc-7aac-4777-ad34-1cdafa109df3 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945848 Jul 26 15:41:31.390310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 450/984] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:41:30 2022] POST /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:31.396541 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:31.397275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] [instance: 0f12547e-bcd6-45c7-afee-0e20f7929840] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:31.404498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:41:31.405039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:41:31.405515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:31.405637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:41:31.405970 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:31.406934 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:31.407376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:31.407823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:41:31.408288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:41:31.420026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:31.421258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:31.422571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:31.423160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:31.423369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] HTTP exception thrown: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Request method failure captured: Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 HTTP/1.1 Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am6GpGsOgmODNq_wbmCNv7IogT8hHP3CLk4Y6q8hnPGDFBZdj2sLjrVY5DnRevgzo7I3H2FPXCqZUcDYpR_pmziYfgRgguD1-cA1cEEE7eQK1MTx1PU_ajeeybBk5FKYBslmtnz7G7xJl5JOEPQOU6NIV9MTZSVn3HyDDEpa_o5yOw Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:31.425073 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_cc117969e9394769a471d512ce80734a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/cc117969e9394769a471d512ce80734a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/cc117969e9394769a471d512ce80734a"}]}] Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: cc117969e9394769a471d512ce80734a Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1276408927 Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: c2bf7ea384a142d1bc23b23ab503fca0 Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1276408927-project Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. Jul 26 15:41:31.426603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '0f12547e-bcd6-45c7-afee-0e20f7929840'} Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:31.427528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. Jul 26 15:41:31.430424 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:31.431571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] Returning 404 to user: Instance 0f12547e-bcd6-45c7-afee-0e20f7929840 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:31.431571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-57f47325-2bd8-4c78-b8cc-1be65ada2e5e tempest-ServerRescueNegativeTestJSON-1276408927 tempest-ServerRescueNegativeTestJSON-1276408927-project] 10.222.0.128 "GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840" status: 404 len: 111 microversion: 2.1 time: 0.034961 Jul 26 15:41:31.431571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 451/985] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:31 2022] GET /compute/v2.1/servers/0f12547e-bcd6-45c7-afee-0e20f7929840 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:41:31.444761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for project f81499626e98449897622291738f07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:31.448860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Getting quotas for user c2e3c15511fe433a9278248c528c86e0 and project f81499626e98449897622291738f07f7. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:31.474463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:41:31.482980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:41:31.720882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-42268ca0-f3d4-4ec7-908f-23919d171b03 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.861492 Jul 26 15:41:31.723377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 535/986] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:41:30 2022] POST /compute/v2.1/servers => generated 403 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:41:31.734770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7d1362d2-75d4-4b2d-af7c-ff9ac5f39f70 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:31.740755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7d1362d2-75d4-4b2d-af7c-ff9ac5f39f70 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:32.051634 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7d1362d2-75d4-4b2d-af7c-ff9ac5f39f70 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:32.059420 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7d1362d2-75d4-4b2d-af7c-ff9ac5f39f70 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1242 microversion: 2.1 time: 0.329814 Jul 26 15:41:32.060818 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 452/987] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:31 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1242 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:33.082159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:33.082805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:33.090663 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:33.091116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:33.091889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:33.092322 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:33.156554 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:33.164357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dd197067-e8e1-42cc-be2f-ddcc153494b7 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1294 microversion: 2.1 time: 0.086915 Jul 26 15:41:33.164966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 536/988] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:33 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:34.190598 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:34.191129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:34.199813 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:34.203371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:34.203371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:34.203371 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:34.281797 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:34.291570 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6b38b8b1-61ab-4a90-b0b6-29ea32867974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1300 microversion: 2.1 time: 0.106858 Jul 26 15:41:34.292150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 453/989] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:34 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:35.316246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:35.317670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:35.326366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:35.326682 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:35.327746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:35.328294 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:35.546488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:35.555023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fef1fa33-f848-4770-9beb-631ede7b19e5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.242182 Jul 26 15:41:35.555611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 537/990] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:35 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:36.048457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-afc6701b-e915-412e-a17c-25d5e3a135c0 req-149cf3c0-2a7e-49ef-a9c8-06e9cdcc2ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1", "tag": "d981ff82-1abd-4949-a1c2-fc61aeb64442"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:36.059369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-afc6701b-e915-412e-a17c-25d5e3a135c0 req-149cf3c0-2a7e-49ef-a9c8-06e9cdcc2ad1 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:36.059825 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-afc6701b-e915-412e-a17c-25d5e3a135c0 req-149cf3c0-2a7e-49ef-a9c8-06e9cdcc2ad1 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:36.077961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-afc6701b-e915-412e-a17c-25d5e3a135c0 req-149cf3c0-2a7e-49ef-a9c8-06e9cdcc2ad1 service nova] Creating event network-changed:d981ff82-1abd-4949-a1c2-fc61aeb64442 for instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 on hv-cinder-85103 Jul 26 15:41:36.083515 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-afc6701b-e915-412e-a17c-25d5e3a135c0 req-149cf3c0-2a7e-49ef-a9c8-06e9cdcc2ad1 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039719 Jul 26 15:41:36.089857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 454/991] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:36.577467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:36.578877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:36.586658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:36.587105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:36.587986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:36.588450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:36.986633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:36.996056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-61d82b7e-5ef6-408d-90b2-15fcc0b31771 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.422596 Jul 26 15:41:36.997133 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 538/992] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:36 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:38.018137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:38.018849 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:38.025864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:38.026317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:38.027121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:38.027563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:38.171210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:38.179872 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-08082279-31fe-4889-9ffb-d4454ccf5d25 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.165417 Jul 26 15:41:38.180922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 455/993] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:38 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:39.200919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:39.201566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:39.208201 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:39.208683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:39.209485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:39.209921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:39.349195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:39.357035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-29eec7a7-229b-4bc5-920d-c4794bb5a73d tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.159964 Jul 26 15:41:39.357598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 539/994] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:39 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:40.140519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e76d8f9d-27be-4671-8678-fff5246e4482"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:40.143064 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:40.150155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.150606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.151384 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.151819 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.234900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: POST /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments HTTP/1.1 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 74 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:40.236660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {"volumeAttachment": {"volumeId": "e76d8f9d-27be-4671-8678-fff5246e4482"}} Jul 26 15:41:40.238438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'server_id': '81603c0d-50b8-4ca7-8487-8063b5ec69e7', 'body': {'volumeAttachment': {'volumeId': 'e76d8f9d-27be-4671-8678-fff5246e4482'}}} Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:40.239364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:40.241592 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 400 to user: Invalid volume: volume e76d8f9d-27be-4671-8678-fff5246e4482 is already attached to instances: 81603c0d-50b8-4ca7-8487-8063b5ec69e7 {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8389bd4b-37b9-4b1c-a2d3-3004b819f13c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101824 Jul 26 15:41:40.243124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 456/995] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:41:40 2022] POST /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:41:40.306754 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:40.307324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:40.313949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.314403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.315170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.315609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.390678 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:40.391352 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:40.398772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.399342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.400146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.401043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.410905 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'services' on Instance uuid 81603c0d-50b8-4ca7-8487-8063b5ec69e7 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:40.559461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:40.570590 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-93bed46c-8bd2-4754-be86-e43c2669c341 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.187031 Jul 26 15:41:40.587276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 457/996] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:40 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:40.658707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e888f3f3-2da6-493a-9b4e-1c61e0a90427 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments/e76d8f9d-27be-4671-8678-fff5246e4482" status: 202 len: 0 microversion: 2.1 time: 0.356781 Jul 26 15:41:40.659437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 540/997] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:41:40 2022] DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments/e76d8f9d-27be-4671-8678-fff5246e4482 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:40.669244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:40.671794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:40.678018 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.679674 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.680842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:40.681550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:40.721775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0c888086-1ed9-4e67-b44a-d0d538d0bdbd tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053835 Jul 26 15:41:40.721775 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 458/998] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:40 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:41.592137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:41.592917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=10 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:41.596978 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:41.597674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:41.604633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.605121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.605899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.606340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.738367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:41.742222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:41.750071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:41.758110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.758110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.758110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.758110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.758592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-05f172d5-9e34-493f-bbba-420117696a93 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.167811 Jul 26 15:41:41.759154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 541/999] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:41 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:41.800108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c549c88c-9815-4c20-9f2e-8e98174707d5 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065706 Jul 26 15:41:41.800909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 459/1000] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:41 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:41:41.868808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:41.869309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:41.875438 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.875896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.876704 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:41.877145 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:41.907150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:42.207773 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-01887d39-837b-4fc2-a387-145d397385a4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 204 len: 0 microversion: 2.1 time: 0.342967 Jul 26 15:41:42.208376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 542/1001] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:41 2022] DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:41:42.217396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:42.218010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:42.220009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:42.224923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:42.225373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:42.226142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:42.226786 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:42.405170 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:42.414919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2a679e7c-ccb4-4052-9aa1-24dfc2d6514c tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1680 microversion: 2.1 time: 0.201361 Jul 26 15:41:42.415820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 460/1002] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:42 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:42.652546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-2bd07695-5ed7-48fd-a11e-5b74745919df req-4421c74c-e9f2-4115-8fa0-1b247750e25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1", "name": "network-vif-plugged", "status": "completed", "tag": "d981ff82-1abd-4949-a1c2-fc61aeb64442"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:42.658488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:42.663667 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-2bd07695-5ed7-48fd-a11e-5b74745919df req-4421c74c-e9f2-4115-8fa0-1b247750e25d service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:42.664805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-2bd07695-5ed7-48fd-a11e-5b74745919df req-4421c74c-e9f2-4115-8fa0-1b247750e25d service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:42.675838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-2bd07695-5ed7-48fd-a11e-5b74745919df req-4421c74c-e9f2-4115-8fa0-1b247750e25d service nova] Creating event network-vif-plugged:d981ff82-1abd-4949-a1c2-fc61aeb64442 for instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 on hv-cinder-85103 Jul 26 15:41:42.681086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-2bd07695-5ed7-48fd-a11e-5b74745919df req-4421c74c-e9f2-4115-8fa0-1b247750e25d service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033183 Jul 26 15:41:42.681666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 543/1003] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:42.784431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:42.785084 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:42.792941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:42.795286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:42.795286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:42.795286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:42.933867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:42.941588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-950c327d-e79f-461f-b1a6-8ab8c402c995 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.162140 Jul 26 15:41:42.942178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 461/1004] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:42 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:43.439786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:43.440519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:43.447921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:43.448377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:43.449203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:43.449648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:43.467410 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:43.603853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:43.613255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28b04b31-5610-4b95-8e86-ffdc1f616bce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1680 microversion: 2.1 time: 0.177571 Jul 26 15:41:43.614435 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 544/1005] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:43 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:43.966924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:43.968110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:43.976286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:43.976879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:43.979142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:43.979651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:44.175188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:44.183782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-683a93f1-2e11-44fb-bf04-3683154b3933 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.222219 Jul 26 15:41:44.184298 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 462/1006] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:43 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:44.527344 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1205054619"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:44.528061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:44.535531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:44.536257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:44.537146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:44.537611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:44.635869 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:44.636614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:44.644823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:44.645268 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:44.646476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:44.647865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:44.679809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.network.security_group_api [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Removing security group 0a707b5c-38d1-45a4-83e5-2d06dbf68a35 from port 74435adb-9de7-4203-96da-1b7dc6de5828 Jul 26 15:41:44.878802 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:44.891414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-99db69ad-4983-4e8b-b820-7fc8f997f981 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1680 microversion: 2.1 time: 0.259768 Jul 26 15:41:44.892311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 463/1007] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:44 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:45.186867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b2cd854f-9e02-4b20-a2e5-0d30f451b4d0 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action" status: 202 len: 0 microversion: 2.1 time: 0.668304 Jul 26 15:41:45.187210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 545/1008] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:41:44 2022] POST /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:45.203948 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-6792895d-672e-4f8d-ab29-1066fff868a0 req-be3e5d4e-cedf-49b7-8d43-00b9c7800e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:45.206878 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:45.207661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:45.214751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.215380 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:45.216647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.217245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:45.239895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-6792895d-672e-4f8d-ab29-1066fff868a0 req-be3e5d4e-cedf-49b7-8d43-00b9c7800e41 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.242824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-6792895d-672e-4f8d-ab29-1066fff868a0 req-be3e5d4e-cedf-49b7-8d43-00b9c7800e41 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:45.285650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-6792895d-672e-4f8d-ab29-1066fff868a0 req-be3e5d4e-cedf-49b7-8d43-00b9c7800e41 service nova] Creating event network-changed:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:41:45.306400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-6792895d-672e-4f8d-ab29-1066fff868a0 req-be3e5d4e-cedf-49b7-8d43-00b9c7800e41 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107376 Jul 26 15:41:45.309440 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 464/1009] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:45.504298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:45.528612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2a7ced65-60e2-4330-8fda-8275bbfab428 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1367 microversion: 2.1 time: 0.327041 Jul 26 15:41:45.529975 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 546/1010] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:45 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:45.658959 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-4dbe42ae-d19b-4c55-ae9b-bbd48bfe6bb2 req-7c824402-b49f-4dba-a342-801277020cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81603c0d-50b8-4ca7-8487-8063b5ec69e7", "name": "network-vif-deleted", "tag": "3f832667-173e-45d5-bdc2-2c4340f882ab"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:45.686843 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4dbe42ae-d19b-4c55-ae9b-bbd48bfe6bb2 req-7c824402-b49f-4dba-a342-801277020cc9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.687458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4dbe42ae-d19b-4c55-ae9b-bbd48bfe6bb2 req-7c824402-b49f-4dba-a342-801277020cc9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:45.703041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-4dbe42ae-d19b-4c55-ae9b-bbd48bfe6bb2 req-7c824402-b49f-4dba-a342-801277020cc9 service nova] Creating event network-vif-deleted:3f832667-173e-45d5-bdc2-2c4340f882ab for instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 on hv-cinder-85103 Jul 26 15:41:45.709490 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-4dbe42ae-d19b-4c55-ae9b-bbd48bfe6bb2 req-7c824402-b49f-4dba-a342-801277020cc9 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055083 Jul 26 15:41:45.711065 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 465/1011] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:45.918293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:45.919545 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:45.940837 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.944965 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:45.948553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:45.954327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:46.095879 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:46.105775 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4de09afa-e05a-457e-b826-9616891fed58 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 200 len: 1330 microversion: 2.1 time: 0.195367 Jul 26 15:41:46.106525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 547/1012] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:45 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 1330 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:46.558994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:46.559720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:46.567210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:46.567988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:46.569001 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:46.569607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.003769 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:47.010975 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:47.034291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.037569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.037569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.037569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.158857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:47.164196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-925d9b22-5b95-46e9-86df-be875436c675 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1553 microversion: 2.1 time: 0.610365 Jul 26 15:41:47.165730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 466/1013] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:46 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1553 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:47.170963 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lazy-loading 'services' on Instance uuid 2c8b13e1-6947-4d7e-ad77-0bfd0858524e {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:47.174093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:47.175078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:47.183101 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.183832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.184627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.185342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.200215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 HTTP/1.1 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:47.202152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:41:47.203745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '81603c0d-50b8-4ca7-8487-8063b5ec69e7'} Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:47.204782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:41:47.206319 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:47.208665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:47.209694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bf4edb53-210a-483b-95c6-14a85a5dbb62 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 404 len: 111 microversion: 2.1 time: 0.042693 Jul 26 15:41:47.210265 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 467/1014] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:47 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:41:47.220823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:47.221538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:47.231903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.232544 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.233457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.234160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.332561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-86dfc3f8-bee6-4c2d-bbdb-c75de1217c6c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120779 Jul 26 15:41:47.333173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 468/1015] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:41:47 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:47.341526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c2b5c072-1639-46b9-83a2-e22b88115fe7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '.version_select at 0x7f346abc4d30>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:47.463607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c2b5c072-1639-46b9-83a2-e22b88115fe7 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713262974" status: 202 len: 0 microversion: 2.1 time: 0.128881 Jul 26 15:41:47.464846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 469/1016] 10.222.0.128 () {58 vars in 1226 bytes} [Tue Jul 26 15:41:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713262974 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:47.469906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-fd613279-7e44-427d-959d-90718488f3d3 req-0fe96573-5750-426b-97cd-b63fbf785199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:47.473719 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f3c276fe-22c1-4907-9915-0517332a8987 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments/f4a8405d-6d8a-49a9-ac35-71249fcee2c4" status: 202 len: 0 microversion: 2.1 time: 0.473838 Jul 26 15:41:47.477318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 548/1017] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:41:46 2022] DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments/f4a8405d-6d8a-49a9-ac35-71249fcee2c4 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:41:47.496282 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-fd613279-7e44-427d-959d-90718488f3d3 req-0fe96573-5750-426b-97cd-b63fbf785199 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.497133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-fd613279-7e44-427d-959d-90718488f3d3 req-0fe96573-5750-426b-97cd-b63fbf785199 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.506143 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:47.512346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:47.516081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-fd613279-7e44-427d-959d-90718488f3d3 req-0fe96573-5750-426b-97cd-b63fbf785199 service nova] Creating event network-changed:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:41:47.521606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-fd613279-7e44-427d-959d-90718488f3d3 req-0fe96573-5750-426b-97cd-b63fbf785199 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055400 Jul 26 15:41:47.522442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 470/1018] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:47.523465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.524749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.526005 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:47.526626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:47.608936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6c487c2-e4af-41e5-a196-0b5feb79100f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108784 Jul 26 15:41:47.608936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 549/1019] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:47 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:48.631107 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:48.633937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:48.652880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:48.653346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:48.654158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:48.654602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:48.688746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e178aa40-ae9d-4369-a143-2b360ec8101a tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073036 Jul 26 15:41:48.689852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 471/1020] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:48 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:48.905180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d838115e-07d9-4baf-873b-707553afc852 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: .version_select at 0x7f346ac10940>, body: {"keypair": {"name": "tempest-keypair-1898857927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhTUwem+0o4JLKgw2tNMDNaE4TfZ64ovdH/zI8ZbZST6MHUnsEOA6EVfCdM+iEI2j8VAmYU1pfP98leHzXxXhPHh7ktEG/L6dEQ7Knab7jb13VURD8XbBNbjpa5/pWP2g=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:48.922304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-d838115e-07d9-4baf-873b-707553afc852 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:48.926489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-d838115e-07d9-4baf-873b-707553afc852 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:49.049423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d838115e-07d9-4baf-873b-707553afc852 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148294 Jul 26 15:41:49.050031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 550/1021] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:41:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:49.564369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-0847881d-59c0-4692-9fc7-4ba5df96f527 req-667fb614-6402-4b03-863d-a49fef7638be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1", "tag": "d981ff82-1abd-4949-a1c2-fc61aeb64442"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:49.575924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-0847881d-59c0-4692-9fc7-4ba5df96f527 req-667fb614-6402-4b03-863d-a49fef7638be service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:49.576687 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-0847881d-59c0-4692-9fc7-4ba5df96f527 req-667fb614-6402-4b03-863d-a49fef7638be service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:49.580964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:49.589546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-0847881d-59c0-4692-9fc7-4ba5df96f527 req-667fb614-6402-4b03-863d-a49fef7638be service nova] Creating event network-changed:d981ff82-1abd-4949-a1c2-fc61aeb64442 for instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 on hv-cinder-85103 Jul 26 15:41:49.594752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-0847881d-59c0-4692-9fc7-4ba5df96f527 req-667fb614-6402-4b03-863d-a49fef7638be service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Jul 26 15:41:49.595667 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 472/1022] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:49.701460 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:49.703573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:49.716642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:49.716642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:49.716642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:49.716642 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:49.748092 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a98ee15-8c15-4c78-8597-1f8c67b522a5 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050777 Jul 26 15:41:49.754723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 551/1023] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:41:49 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:41:49.765736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:49.765736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:49.772520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:49.772999 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:49.775163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:49.775831 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:49.872383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] HTTP exception thrown: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e is not attached to volume f4a8405d-6d8a-49a9-ac35-71249fcee2c4 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Request method failure captured: Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments/f4a8405d-6d8a-49a9-ac35-71249fcee2c4 HTTP/1.1 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Apmsr_h33DJcRAEL_6EMiksRHxq9ITB7ISRDPMXCj0n7Ck0fXE9INAJdaXqFD-_AT4XqRs8Ne_Qbp9IqUMh49vV1iVFM9Kb4TpySjtgNoiaas9h1nq3qkBzB0ckBsSbjZKabtAfz8mrSgQnWwtp19Pe4Z0cVyUUg1jw9iJgYMdW3MY Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 7c892ef56ae9488089386d1a733ae3c0 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:49.884114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/7c892ef56ae9488089386d1a733ae3c0"}]}] Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 7c892ef56ae9488089386d1a733ae3c0 Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-TestMinimumBasicScenario-1856965423-project Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 1f6f23b2e4134aa78862287f57323731 Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-TestMinimumBasicScenario-1856965423-project Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:49.885968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e is not attached to volume f4a8405d-6d8a-49a9-ac35-71249fcee2c4 Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'server_id': '2c8b13e1-6947-4d7e-ad77-0bfd0858524e', 'id': 'f4a8405d-6d8a-49a9-ac35-71249fcee2c4'} Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4a8405d-6d8a-49a9-ac35-71249fcee2c4. Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:49.886842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e is not attached to volume f4a8405d-6d8a-49a9-ac35-71249fcee2c4 Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e is not attached to volume f4a8405d-6d8a-49a9-ac35-71249fcee2c4 Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:49.888325 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Returning 404 to user: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e is not attached to volume f4a8405d-6d8a-49a9-ac35-71249fcee2c4 {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:49.889308 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d0c67035-c0fc-4f8e-97ff-6effb2160628 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments/f4a8405d-6d8a-49a9-ac35-71249fcee2c4" status: 404 len: 154 microversion: 2.1 time: 0.132184 Jul 26 15:41:49.889308 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 473/1024] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:41:49 2022] DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e/os-volume_attachments/f4a8405d-6d8a-49a9-ac35-71249fcee2c4 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:41:51.268078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:51.268606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:51.275184 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:51.275602 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:51.276378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:51.276855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:51.302345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:41:51.527908 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7848b72e-4724-4e89-98e7-03cbdccaa1c4 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 204 len: 0 microversion: 2.1 time: 0.263665 Jul 26 15:41:51.528610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 552/1025] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:41:51 2022] DELETE /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:41:51.537202 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:51.537873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:51.545728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:51.546173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:51.546941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:51.547369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:51.599585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-382468007", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c44aad34-88bd-4a3d-a4b4-00a0a6488a28"}], "security_groups": [{"name": "tempest-securitygroup--146374112"}], "key_name": "tempest-keypair-1898857927", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:51.700660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:51.708306 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-34465a41-9ae1-48f7-8277-dc89229e35dd tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1558 microversion: 2.1 time: 0.175199 Jul 26 15:41:51.709155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 474/1026] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:51 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:51.715952 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] validate_networks() for [('c44aad34-88bd-4a3d-a4b4-00a0a6488a28', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:41:52.152951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:41:52.153522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:41:52.154493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:41:52.155549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:41:52.155549 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:41:52.165699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:52.166912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:52.168684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:52.168684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:52.186612 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:41:52.191373 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Getting quotas for user 494aa7af44284866b02f2a295b8b05aa and project 1ae9a8b5a9ec48f392c43a71f142b102. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:41:52.203588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:41:52.206067 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:41:52.319109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-96933c02-5e48-4381-8306-46694530fbc8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.724138 Jul 26 15:41:52.319963 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 553/1027] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:41:51 2022] POST /compute/v2.1/servers => generated 403 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 15:41:52.332679 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f1243506-d041-433b-9820-5c7e25fdbade tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:52.333693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f1243506-d041-433b-9820-5c7e25fdbade tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:52.395153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f1243506-d041-433b-9820-5c7e25fdbade tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:52.402410 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f1243506-d041-433b-9820-5c7e25fdbade tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1245 microversion: 2.1 time: 0.075065 Jul 26 15:41:52.402980 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 475/1028] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:52 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:52.731758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:52.732357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:52.739767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:52.740227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:52.741587 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:52.742210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:52.892883 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:52.900502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4bf1c4a0-abac-4ffd-99c3-26fbe13127b9 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1558 microversion: 2.1 time: 0.173357 Jul 26 15:41:52.901103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 554/1029] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:52 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:53.424701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:53.426061 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:53.435403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:53.436707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:53.438275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:53.439276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:53.523360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:53.534276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cd1129a3-93b3-489e-9982-3e0565bc7ad1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1249 microversion: 2.1 time: 0.114428 Jul 26 15:41:53.534865 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 476/1030] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:53 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:53.927292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:53.929281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:53.936448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:53.937003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:53.937893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:53.938421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:54.085307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:54.097834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eb32f2fd-850a-4ab4-ba0f-1302c70a90cb tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1558 microversion: 2.1 time: 0.178054 Jul 26 15:41:54.098778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 555/1031] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:53 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:54.145601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-4a8c6788-359c-4aee-bc7e-bd09bd32ebf7 req-be28fcbd-32eb-4f4c-a250-73b75e428a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8b13e1-6947-4d7e-ad77-0bfd0858524e", "name": "network-vif-deleted", "tag": "74435adb-9de7-4203-96da-1b7dc6de5828"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:54.155783 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4a8c6788-359c-4aee-bc7e-bd09bd32ebf7 req-be28fcbd-32eb-4f4c-a250-73b75e428a24 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:54.156223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4a8c6788-359c-4aee-bc7e-bd09bd32ebf7 req-be28fcbd-32eb-4f4c-a250-73b75e428a24 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:54.167463 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-4a8c6788-359c-4aee-bc7e-bd09bd32ebf7 req-be28fcbd-32eb-4f4c-a250-73b75e428a24 service nova] Creating event network-vif-deleted:74435adb-9de7-4203-96da-1b7dc6de5828 for instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e on hv-cinder-85103 Jul 26 15:41:54.172647 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-4a8c6788-359c-4aee-bc7e-bd09bd32ebf7 req-be28fcbd-32eb-4f4c-a250-73b75e428a24 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jul 26 15:41:54.173259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 477/1032] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:54.564933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:54.564933 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:54.573924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:54.575012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:54.576915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:54.577868 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:54.690491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:54.702136 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-67a23dd0-d23c-40b4-819a-6808973851ca tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1305 microversion: 2.1 time: 0.149716 Jul 26 15:41:54.703065 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 556/1033] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:54 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:55.120667 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:55.122310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:55.128159 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:55.128628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:55.129550 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:55.130173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:55.170693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:55.170892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:55.171348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lazy-loading 'fault' on Instance uuid 2c8b13e1-6947-4d7e-ad77-0bfd0858524e {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:41:55.226046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6f23b2e4134aa78862287f57323731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c892ef56ae9488089386d1a733ae3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:55.234740 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b5f33235-1f83-4f5b-a939-698960207f5f tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 200 len: 1353 microversion: 2.1 time: 0.119141 Jul 26 15:41:55.235409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 478/1034] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:55 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 1353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:55.723197 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:55.724520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:55.732373 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:55.732861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:55.733646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:55.735489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:55.906889 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:55.915387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-75806cdb-862e-4171-b07a-8f4d782f4694 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.195851 Jul 26 15:41:55.915986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 557/1035] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:55 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:56.257685 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:56.258324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] [instance: 2c8b13e1-6947-4d7e-ad77-0bfd0858524e] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:56.266799 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:56.267242 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:56.268010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:56.268440 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:56.282671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] HTTP exception thrown: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Request method failure captured: Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e HTTP/1.1 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Apmsr_h33DJcRAEL_6EMiksRHxq9ITB7ISRDPMXCj0n7Ck0fXE9INAJdaXqFD-_AT4XqRs8Ne_Qbp9IqUMh49vV1iVFM9Kb4TpySjtgNoiaas9h1nq3qkBzB0ckBsSbjZKabtAfz8mrSgQnWwtp19Pe4Z0cVyUUg1jw9iJgYMdW3MY Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 7c892ef56ae9488089386d1a733ae3c0 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:41:56.284300 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/7c892ef56ae9488089386d1a733ae3c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/7c892ef56ae9488089386d1a733ae3c0"}]}] Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 7c892ef56ae9488089386d1a733ae3c0 Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1856965423 Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-TestMinimumBasicScenario-1856965423-project Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 1f6f23b2e4134aa78862287f57323731 Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-TestMinimumBasicScenario-1856965423-project Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. Jul 26 15:41:56.285912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '2c8b13e1-6947-4d7e-ad77-0bfd0858524e'} Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:41:56.286759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. Jul 26 15:41:56.288158 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:41:56.290024 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Returning 404 to user: Instance 2c8b13e1-6947-4d7e-ad77-0bfd0858524e could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:41:56.290024 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-901e4ae4-629c-45f6-9a69-ae02334574da tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e" status: 404 len: 111 microversion: 2.1 time: 0.032051 Jul 26 15:41:56.290024 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 479/1036] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:56 2022] GET /compute/v2.1/servers/2c8b13e1-6947-4d7e-ad77-0bfd0858524e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:41:56.295055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25ae6fbf-e2ef-4152-8c4e-49aa670ab860 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] Calling method '.version_select at 0x7f34733b0c10>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:56.356872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-25ae6fbf-e2ef-4152-8c4e-49aa670ab860 tempest-TestMinimumBasicScenario-1856965423 tempest-TestMinimumBasicScenario-1856965423-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1273219420" status: 202 len: 0 microversion: 2.1 time: 0.065348 Jul 26 15:41:56.357738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 558/1037] 10.222.0.128 () {58 vars in 1277 bytes} [Tue Jul 26 15:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1273219420 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:41:56.427183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-285be5b2-b7b0-4049-bdd1-0be0c2beb69b req-37a3f08a-7dd8-4b3b-ba8d-c41e9631e33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba220cc-8230-469c-97f2-4e9dc8a6f7a0", "tag": "c470964b-1007-4204-8ed3-132f86d700d7"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:41:56.472547 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-285be5b2-b7b0-4049-bdd1-0be0c2beb69b req-37a3f08a-7dd8-4b3b-ba8d-c41e9631e33a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:56.474134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-285be5b2-b7b0-4049-bdd1-0be0c2beb69b req-37a3f08a-7dd8-4b3b-ba8d-c41e9631e33a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:56.486304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-285be5b2-b7b0-4049-bdd1-0be0c2beb69b req-37a3f08a-7dd8-4b3b-ba8d-c41e9631e33a service nova] Creating event network-changed:c470964b-1007-4204-8ed3-132f86d700d7 for instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 on hv-cinder-85103 Jul 26 15:41:56.491221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-285be5b2-b7b0-4049-bdd1-0be0c2beb69b req-37a3f08a-7dd8-4b3b-ba8d-c41e9631e33a service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072695 Jul 26 15:41:56.492636 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 480/1038] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:41:56.943100 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:56.944479 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:56.957677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:56.963783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:56.963783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:56.963783 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:57.102747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:57.111722 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0d6c28c7-d2d4-41a5-bb04-559298799e36 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.175891 Jul 26 15:41:57.126144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 559/1039] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:56 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:41:58.135025 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:58.135863 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:58.137770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:41:58.142792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:58.143305 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:58.144086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:58.144556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:58.483135 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:58.491218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-dd88e215-0a3f-4b54-a360-77263181008e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.361450 Jul 26 15:41:58.493620 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 481/1040] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:58 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:41:59.522619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:41:59.523379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:41:59.530867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:59.531497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:59.532272 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:41:59.532731 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:41:59.702644 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:41:59.712906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-95e4866f-27a6-445e-b929-efe2ca45475b tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.194050 Jul 26 15:41:59.713498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 560/1041] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:41:59 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:00.734375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:00.734998 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:00.742833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:00.743360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:00.744109 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:00.744587 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:01.084105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:01.092367 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bb7dffbf-9291-40d3-a5f0-ad994e3fe5b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.362167 Jul 26 15:42:01.096094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 482/1042] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:00 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:42:02.119463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:02.120854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:02.128388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:02.129375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:02.130381 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:02.131015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:02.175123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:02.200913 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=10 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:02.355572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:02.357815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:02.383060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bcc5ccf8-cbab-4110-9a8d-69f7a9440578 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.253733 Jul 26 15:42:02.383060 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 561/1043] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:02 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:03.008317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-bbe21b33-ec6c-495a-8a31-f37315a90dd4 req-df4cb19e-dd2b-481e-acd2-c15527e1cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba220cc-8230-469c-97f2-4e9dc8a6f7a0", "name": "network-vif-plugged", "status": "completed", "tag": "c470964b-1007-4204-8ed3-132f86d700d7"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:03.018692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:03.025763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bbe21b33-ec6c-495a-8a31-f37315a90dd4 req-df4cb19e-dd2b-481e-acd2-c15527e1cfa2 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:03.026302 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-bbe21b33-ec6c-495a-8a31-f37315a90dd4 req-df4cb19e-dd2b-481e-acd2-c15527e1cfa2 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:03.038387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-bbe21b33-ec6c-495a-8a31-f37315a90dd4 req-df4cb19e-dd2b-481e-acd2-c15527e1cfa2 service nova] Creating event network-vif-plugged:c470964b-1007-4204-8ed3-132f86d700d7 for instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 on hv-cinder-85103 Jul 26 15:42:03.044675 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-bbe21b33-ec6c-495a-8a31-f37315a90dd4 req-df4cb19e-dd2b-481e-acd2-c15527e1cfa2 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041199 Jul 26 15:42:03.045430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 483/1044] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:03.396801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:03.397657 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:03.408144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:03.408144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:03.408368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:03.408651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:03.567815 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:03.579373 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1c3fdeac-a73e-4024-bf72-8c0e1a3da728 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.186355 Jul 26 15:42:03.580046 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 562/1045] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:03 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:04.602055 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:04.602808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:04.610023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:04.613314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:04.613314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:04.613314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:04.897654 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:04.916813 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-898aef45-772b-4cd3-8cb5-cfe3973125ea tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1370 microversion: 2.1 time: 0.319467 Jul 26 15:42:04.917689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 484/1046] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:04 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:05.939802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:05.940396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:05.949474 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:05.950211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:05.951166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:05.951763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:06.147645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:06.157578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f1e44498-09c9-4cfb-ab7b-e55a8b495531 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1557 microversion: 2.1 time: 0.221913 Jul 26 15:42:06.159583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 563/1047] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:05 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:06.180205 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:06.181084 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:06.192458 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:06.194509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:06.196755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:06.197476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:06.290208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b9b5082e-7f22-426f-ad4f-088830552d31 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113821 Jul 26 15:42:06.290967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 485/1048] 10.222.0.128 () {58 vars in 1280 bytes} [Tue Jul 26 15:42:06 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:42:07.503160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-8644b305-2f79-41d4-91b8-9b3d1a26039f req-11140b8f-6b28-495f-9701-0951f2f421a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba220cc-8230-469c-97f2-4e9dc8a6f7a0", "tag": "c470964b-1007-4204-8ed3-132f86d700d7"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:07.521805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8644b305-2f79-41d4-91b8-9b3d1a26039f req-11140b8f-6b28-495f-9701-0951f2f421a9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:07.527227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8644b305-2f79-41d4-91b8-9b3d1a26039f req-11140b8f-6b28-495f-9701-0951f2f421a9 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:07.555263 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-8644b305-2f79-41d4-91b8-9b3d1a26039f req-11140b8f-6b28-495f-9701-0951f2f421a9 service nova] Creating event network-changed:c470964b-1007-4204-8ed3-132f86d700d7 for instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 on hv-cinder-85103 Jul 26 15:42:07.566026 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-8644b305-2f79-41d4-91b8-9b3d1a26039f req-11140b8f-6b28-495f-9701-0951f2f421a9 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067237 Jul 26 15:42:07.566723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 564/1049] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:10.520318 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:10.520931 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:10.527596 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:10.528041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:10.528832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:10.529267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:10.553836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-cf1a84d5-5767-4341-91b1-733c71bdadac tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/ips" status: 200 len: 150 microversion: 2.20 time: 0.038038 Jul 26 15:42:10.554546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 486/1050] 10.222.0.128 () {60 vars in 1294 bytes} [Tue Jul 26 15:42:10 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:42:12.897799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:12.898504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:12.904900 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:12.905358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:12.906134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:12.906574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:12.931284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lazy-loading 'flavor' on Instance uuid 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:13.467652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-083da601-f9a8-45cf-a15c-a965740ebca3 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/action" status: 202 len: 0 microversion: 2.20 time: 0.574723 Jul 26 15:42:13.468231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 565/1051] 10.222.0.128 () {62 vars in 1324 bytes} [Tue Jul 26 15:42:12 2022] POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:13.479211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:13.480434 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:13.487436 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:13.487889 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:13.488846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:13.489272 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:13.639461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:13.648457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:13.650161 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:13.651356 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-17f448f8-efe0-4e90-ba74-482846b6c5c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.177551 Jul 26 15:42:13.651928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 487/1052] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:13 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:14.679231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:14.681099 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:14.691838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:14.696012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:14.696850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:14.698213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:14.699003 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:14.896805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:14.904063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:14.905643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:14.906846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-25f8bf1b-48f8-48a3-8330-dce6aeb17774 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.234243 Jul 26 15:42:14.907413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 566/1053] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:14 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:15.931373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:15.931924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:15.938696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:15.939992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:15.939992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:15.940454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:16.074086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:16.082211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:16.083764 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:16.085078 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b3f85a80-0095-4f55-906c-38cabbeb155f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.158792 Jul 26 15:42:16.085679 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 488/1054] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:15 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:17.112013 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:17.112661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:17.122202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:17.122706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:17.124057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:17.124521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:17.288628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:17.297440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:17.299234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:17.301278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a5f66a53-eb52-4feb-b1b8-83af92fc05bc tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.196077 Jul 26 15:42:17.302207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 567/1055] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:17 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:18.333092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:18.333702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:18.341074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:18.341519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:18.342291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:18.342726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:18.485279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:18.494419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:18.496197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:18.497441 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0a08e3d7-b0ea-4c3c-bee1-404f7b261a58 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.168326 Jul 26 15:42:18.498001 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 489/1056] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:18 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:19.521027 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:19.521621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:19.528405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:19.528881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:19.529640 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:19.530072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:19.669185 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:19.677544 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:19.680376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:19.681135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-39736959-e9ea-4cb9-8e87-d2b6b6905b2e tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.164012 Jul 26 15:42:19.681708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 568/1057] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:19 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:20.704383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:20.704993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:20.712043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:20.712611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:20.713326 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:20.713763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:20.852155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:20.860442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:20.861992 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:20.863148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-198fd957-b6f1-492e-a639-710fbf3debaf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.163018 Jul 26 15:42:20.863757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 490/1058] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:20 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:21.886256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:21.886865 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:21.893393 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:21.893848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:21.894701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:21.895148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:22.031311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:22.040161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:22.041709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:22.042978 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8611bde2-94ba-45c6-a97e-2bb4953baebf tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.160861 Jul 26 15:42:22.043539 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 569/1059] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:21 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:23.067019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:23.067623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:23.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:23.075692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:23.076456 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:23.076970 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:23.081287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=86 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:23.217777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:23.225991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:23.227339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:23.228536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-38006ba2-17c6-4911-a715-f78d12194351 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.165560 Jul 26 15:42:23.229099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 491/1060] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:23 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:24.251882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:24.252566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:24.260173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:24.260627 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:24.261398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:24.261838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:24.399809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:24.407768 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:24.409347 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:24.410514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-513d0142-13d4-4cec-b8a4-40848cfe435b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.162657 Jul 26 15:42:24.411071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 570/1061] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:24 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:25.435746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:25.436364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:25.443070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:25.443518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:25.445253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:25.445381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:25.580439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:25.588837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:25.590355 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:25.591524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2a549004-b610-4998-ac97-4784f05e738b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.160076 Jul 26 15:42:25.592094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 492/1062] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:25 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:26.615254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:26.615869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:26.623089 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:26.623543 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:26.626597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:26.626597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:26.758334 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:26.766412 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:26.767911 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:26.769106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ac0af0b6-992c-4bba-b5dc-6e505fa0a9a1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.157730 Jul 26 15:42:26.769661 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 571/1063] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:26 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:26.968618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:26.969164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:26.975930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:26.977526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:26.978411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:26.978853 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:27.002279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-78ce3b94-3924-4a0d-a203-823f8311cff2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/ips" status: 200 len: 146 microversion: 2.1 time: 0.037601 Jul 26 15:42:27.002787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 493/1064] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:42:26 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:27.794332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:27.794931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:27.802656 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:27.803103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:27.803896 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:27.804364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:27.937981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:27.946492 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:27.948484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:27.949643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1f4f0fe5-41c2-40bc-a3ee-5496246ab420 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.160340 Jul 26 15:42:27.950206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 572/1065] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:27 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:28.732601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51dc04a3-6a17-488b-ab86-4989593bb1bc"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:28.735108 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:28.737509 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=26 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:28.742560 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:28.743022 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:28.743800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:28.744237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:28.972874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:28.973488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:28.980161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:28.980658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:28.981432 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:28.981873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:29.121314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:29.129700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:29.131214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:29.132372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b5267aa2-b822-4ef0-a99a-5ec8173199b4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.163737 Jul 26 15:42:29.132975 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 573/1066] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:28 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:42:29.609844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-40ab7c67-d93f-4b09-938d-aeb38d2b9cc6 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881055 Jul 26 15:42:29.610491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 494/1067] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:42:28 2022] POST /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:30.157134 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:30.157680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:30.164239 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:30.164693 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:30.165482 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:30.165917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:30.306001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:30.315072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:30.316717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:30.317895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9da41a08-c41a-4fbc-8201-25151016b392 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1747 microversion: 2.20 time: 0.164838 Jul 26 15:42:30.318542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 574/1068] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:30 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:42:31.343931 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:31.344598 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:31.351575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:31.352034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:31.352922 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:31.353372 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:31.515846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:31.527219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:31.528950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:31.530135 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-959b3059-fb5e-4d48-85c2-e793315f9770 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1747 microversion: 2.20 time: 0.191722 Jul 26 15:42:31.530694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 495/1069] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:31 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1747 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:32.554167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:32.554801 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:32.562252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:32.562707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:32.563480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:32.563925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:32.767064 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-70e8c54d-3676-48b4-bdcf-02a81b2e6e66 req-e4d06ba5-0bc1-49b9-8106-7a6c52e2d9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "name": "network-vif-plugged", "status": "completed", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:32.779628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-70e8c54d-3676-48b4-bdcf-02a81b2e6e66 req-e4d06ba5-0bc1-49b9-8106-7a6c52e2d9ed service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:32.780076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-70e8c54d-3676-48b4-bdcf-02a81b2e6e66 req-e4d06ba5-0bc1-49b9-8106-7a6c52e2d9ed service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:32.791588 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-70e8c54d-3676-48b4-bdcf-02a81b2e6e66 req-e4d06ba5-0bc1-49b9-8106-7a6c52e2d9ed service nova] Creating event network-vif-plugged:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:42:32.796824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-70e8c54d-3676-48b4-bdcf-02a81b2e6e66 req-e4d06ba5-0bc1-49b9-8106-7a6c52e2d9ed service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Jul 26 15:42:32.797771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 496/1070] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:32.799811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:32.811063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:32.814357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:32.815779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2c628c19-13eb-475a-a203-07b49b9a0d43 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1747 microversion: 2.20 time: 0.265906 Jul 26 15:42:32.826942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 575/1071] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:32 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1747 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:33.841387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:33.842110 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:33.849664 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:33.849917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:33.850692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:33.851188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:33.995385 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:34.003627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:34.030917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:34.030917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4ba89e4f-540c-47c9-a8f9-1ba517346b3d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.169923 Jul 26 15:42:34.030917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 497/1072] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:33 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:35.031802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:35.033758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:35.044457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:35.045118 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:35.046010 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:35.046556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:35.211285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:35.225496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:35.228491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:35.230553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c922ff25-e1d4-4aa0-9cd0-3cf30a9ebd7b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.203017 Jul 26 15:42:35.246870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 576/1073] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:35 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:36.257746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:36.259133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:36.267419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:36.272228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:36.272228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:36.272228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:36.429963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:36.441861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:36.444437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:36.445875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-21f33287-e9c6-4a1e-930c-279de82fd67f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.192207 Jul 26 15:42:36.451923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 498/1074] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:36 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:37.257064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:37.261288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:37.270275 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.270829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.271871 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.272376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.277377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:37.307855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3fb49253-c4d3-4437-bef6-fb79867f4d8c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055139 Jul 26 15:42:37.308593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 577/1075] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:42:37 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:37.321216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:37.321799 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:37.328263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.328743 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.329499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.330173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.360301 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e4134c89-9e9b-4d79-976b-9791b878fd34 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc" status: 200 len: 194 microversion: 2.1 time: 0.043025 Jul 26 15:42:37.360927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 499/1076] 10.222.0.128 () {58 vars in 1418 bytes} [Tue Jul 26 15:42:37 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:37.475298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:37.475915 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:37.482463 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.501770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.501770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.501770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.626579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:37.634898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:37.639383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:37.639383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6edd0158-7da5-496b-90f4-5ee355caaead tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.167166 Jul 26 15:42:37.639383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 578/1077] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:37 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:38.663919 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:38.664553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:38.673217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:38.674076 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:38.674864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:38.675309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:38.862722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:38.874005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:38.875611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:38.876826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-35861b82-1b1d-415e-a4a8-560a56a33660 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.217127 Jul 26 15:42:38.877387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 500/1078] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:38 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:39.162708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44885c2a-525f-4f65-ad9a-1d25e42a93a0"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:39.165086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:39.173158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.173957 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.175007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.175899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.905214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:39.906851 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:39.914256 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.915034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.916007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.917844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:40.086804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:40.097003 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:40.098631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:40.099958 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2afd8496-7fec-4e1a-815d-6860dd3c957d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.201003 Jul 26 15:42:40.113223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 501/1079] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:39 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:42:40.130881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d821bb44-569d-4570-9c8b-5d49803d76ab tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "POST /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976810 Jul 26 15:42:40.136708 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 579/1080] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:42:39 2022] POST /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 194 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:41.127197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:41.127889 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:41.134473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:41.135343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:41.135846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:41.136884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:41.305612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:41.316725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:41.318688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:41.320007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-403b5bfb-1a5c-4a6c-aaca-5bb9a48b6871 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.197059 Jul 26 15:42:41.320791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 502/1081] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:41 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:42:42.346075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:42.347737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:42.356739 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:42.358568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:42.358568 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:42.358920 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:42.565557 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:42.576666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:42.578567 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:42.580194 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f1565f84-499c-4b50-aace-4d986263840b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.240815 Jul 26 15:42:42.581357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 580/1082] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:42 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:43.605996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:43.607697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:43.620639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:43.620639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:43.620639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:43.620639 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:43.770124 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:43.780199 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:43.781879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:43.783221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3208b4f8-5eab-4f86-a44b-ed296e0262d5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.181757 Jul 26 15:42:43.783883 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 503/1083] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:43 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:44.808319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:44.809694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:44.817364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.818261 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.819284 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.819922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.979754 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:44.989874 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:44.991453 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:44.992785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-82cfe0f1-bc04-466a-be52-1c55a2185a96 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.189393 Jul 26 15:42:44.993365 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 581/1084] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:44 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:45.005093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:45.005697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:45.013130 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.013618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.014431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.015050 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.044263 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:42:45.409692 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e647b118-6811-4509-8fbc-6ded744df47b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "DELETE /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 204 len: 0 microversion: 2.1 time: 0.408801 Jul 26 15:42:45.410295 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 504/1085] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:42:44 2022] DELETE /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:45.418609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:45.419216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:45.421305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=32 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:45.426771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.427214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.427982 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.428413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.567405 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:45.575887 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-82f45c17-2c4b-45a0-8e35-8caa31ad0838 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1579 microversion: 2.1 time: 0.161307 Jul 26 15:42:45.576451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 582/1086] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:45 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:46.016393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:46.017187 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:46.024155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:46.024800 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:46.025615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:46.026054 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:46.163619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:46.166014 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:46.173127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:46.174730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:46.176175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ad18d90c-e906-468c-abcb-1fb545bb7e66 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.164234 Jul 26 15:42:46.176780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 505/1087] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:46 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:46.597417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:46.597966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:46.605457 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:46.605910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:46.606705 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:46.607252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:46.754548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:46.763085 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-174832fa-fc3d-4a0b-9fb8-d2e93db4588f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1579 microversion: 2.1 time: 0.169564 Jul 26 15:42:46.763659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 583/1088] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:46 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:47.199444 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:47.199964 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:47.207291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:47.207736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:47.208539 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:47.208975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:47.346311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:47.354192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:47.356621 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:47.357823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-22100237-0f98-47a0-906d-533647f5ed6a tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.162476 Jul 26 15:42:47.358374 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 506/1089] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:47 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:47.784694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:47.785291 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:47.791904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:47.792912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:47.793685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:47.794118 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:47.941681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:47.949712 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d7a449d2-4b97-4d8a-8784-6b12c805433b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1579 microversion: 2.1 time: 0.168880 Jul 26 15:42:47.952948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 584/1090] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:47 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:48.382275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:48.382891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:48.390611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:48.391191 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:48.391994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:48.392545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:48.625804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:48.637229 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:48.640311 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:48.641861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9c7d3f46-2b24-43d2-940c-6961b3cf6073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1742 microversion: 2.20 time: 0.264547 Jul 26 15:42:48.643473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 507/1091] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:48 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1742 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:48.973478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:48.975444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:48.983411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:48.983880 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:48.984776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:48.985214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.056837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:49.060178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:49.068164 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.068740 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.070244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.070891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.106625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1c368720-e841-48a1-81e9-dc6f0659af33 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056428 Jul 26 15:42:49.107324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 508/1092] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:42:49 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:49.251936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:49.252826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:49.258993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.259653 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.260453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.261119 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.280919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:49.290622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7f987285-9283-4440-ad87-04ec10d62d43 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1579 microversion: 2.1 time: 0.321049 Jul 26 15:42:49.291211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 585/1093] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:48 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1579 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:49.307283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c4a0e780-27b7-4d00-bb91-c71063fa4229 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc" status: 200 len: 194 microversion: 2.1 time: 0.059132 Jul 26 15:42:49.308381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 509/1094] 10.222.0.128 () {58 vars in 1418 bytes} [Tue Jul 26 15:42:49 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:42:49.318867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:49.319686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:49.326314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.326758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.327746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.328186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.436945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'services' on Instance uuid 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:49.628437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-ad05be74-1c27-4422-b4d8-544bbd443cbc req-b40c91a7-7ffb-4f05-a444-9889ef736054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f4641a-1f7d-473c-a239-03183b2ef9b9", "name": "network-vif-deleted", "tag": "1bad2d35-9248-4aed-a7c2-1faaec7a1161"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:49.644947 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-ad05be74-1c27-4422-b4d8-544bbd443cbc req-b40c91a7-7ffb-4f05-a444-9889ef736054 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.645397 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-ad05be74-1c27-4422-b4d8-544bbd443cbc req-b40c91a7-7ffb-4f05-a444-9889ef736054 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.660331 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-ad05be74-1c27-4422-b4d8-544bbd443cbc req-b40c91a7-7ffb-4f05-a444-9889ef736054 service nova] Creating event network-vif-deleted:1bad2d35-9248-4aed-a7c2-1faaec7a1161 for instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 on hv-cinder-85103 Jul 26 15:42:49.673066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ed02ed83-7f0d-4c2f-9b98-057a3fd4e99a tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc" status: 202 len: 0 microversion: 2.1 time: 0.357887 Jul 26 15:42:49.674064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 586/1095] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:42:49 2022] DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/51dc04a3-6a17-488b-ab86-4989593bb1bc => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:42:49.692093 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-ad05be74-1c27-4422-b4d8-544bbd443cbc req-b40c91a7-7ffb-4f05-a444-9889ef736054 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053409 Jul 26 15:42:49.696065 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:49.696826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:49.704046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 510/1096] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:42:49.719548 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.720009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.721566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:49.722007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:49.915618 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:49.924541 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:49.926324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:49.928018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c24cb1ed-0e78-4b73-a577-0b506ddfaaa5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1724 microversion: 2.20 time: 0.250971 Jul 26 15:42:49.935916 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 587/1097] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:49 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:50.315023 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:50.315722 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:50.321947 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:50.322413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:50.323339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:50.323752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:50.395051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:50.403149 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0d3d67fc-5d0a-411a-b6a3-b51ec63e527a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1512 microversion: 2.1 time: 0.092220 Jul 26 15:42:50.412345 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 511/1098] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:50 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1512 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:50.805503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-7ed239ba-c3cd-4980-a3ea-26bdc8e00405 req-87f3a285-2297-4379-b0b4-e7f954063906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "name": "network-vif-unplugged", "status": "completed", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:50.820502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7ed239ba-c3cd-4980-a3ea-26bdc8e00405 req-87f3a285-2297-4379-b0b4-e7f954063906 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:50.821055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7ed239ba-c3cd-4980-a3ea-26bdc8e00405 req-87f3a285-2297-4379-b0b4-e7f954063906 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:50.834227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-7ed239ba-c3cd-4980-a3ea-26bdc8e00405 req-87f3a285-2297-4379-b0b4-e7f954063906 service nova] Creating event network-vif-unplugged:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:42:50.839932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-7ed239ba-c3cd-4980-a3ea-26bdc8e00405 req-87f3a285-2297-4379-b0b4-e7f954063906 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041054 Jul 26 15:42:50.840566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 588/1099] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:50.954335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:50.955019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:50.961829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:50.962269 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:50.963035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:50.963555 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:51.408411 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:51.417047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:51.418625 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:51.419888 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-89ec5fa2-8362-46f9-8c4c-4f234bfe756f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1724 microversion: 2.20 time: 0.472078 Jul 26 15:42:51.420561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 512/1100] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:50 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:51.426559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:51.427258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:51.434072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:51.434520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:51.435287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:51.435729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:51.506583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:51.517121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f6408e37-d307-425d-b5d1-c3931c0fbe8a tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1228 microversion: 2.1 time: 0.095112 Jul 26 15:42:51.517710 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 589/1101] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:51 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:52.369495 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:52.370207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:52.377058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.377569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.378354 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.378796 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.405049 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5cc61e0a-215b-4cd4-b65a-497f6fdec3aa tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/ips" status: 200 len: 146 microversion: 2.1 time: 0.039884 Jul 26 15:42:52.405644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 513/1102] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:42:52 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:52.443537 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:52.444717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:52.452919 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.453687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.454838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.455371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.539146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:52.539794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:52.546272 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.546709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.547476 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.554094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.581991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.582798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.583712 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lazy-loading 'fault' on Instance uuid a3f4641a-1f7d-473c-a239-03183b2ef9b9 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:52.626997 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:52.631072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:52.635814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-23c7d1b2-9760-4d19-bb70-f375f09af472 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 200 len: 1233 microversion: 2.1 time: 0.100264 Jul 26 15:42:52.636401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 514/1103] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:52 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 1233 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:52.641436 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:52.643314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:52.644526 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a2a392f8-2f6d-4a90-a045-96ab1bdacd47 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1727 microversion: 2.20 time: 0.205040 Jul 26 15:42:52.645231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 590/1104] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:52 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:52.669828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ad473c7-48a7-4a64-a0c2-b69d403a1700"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:52.672380 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:52.678897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.679355 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:52.680136 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:52.680735 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.117448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:53.117945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:53.124964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.125416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.126188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.126621 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.159683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-459d3481-54a3-4c46-a990-fb08f0058d47 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/44885c2a-525f-4f65-ad9a-1d25e42a93a0" status: 200 len: 194 microversion: 2.1 time: 0.046363 Jul 26 15:42:53.160280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 591/1105] 10.222.0.128 () {58 vars in 1418 bytes} [Tue Jul 26 15:42:53 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/44885c2a-525f-4f65-ad9a-1d25e42a93a0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:42:53.172886 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:53.173387 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:53.180125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.180885 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.181476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.181907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.197867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:53.264125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'services' on Instance uuid 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:53.502654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8051288f-1abb-4a50-8575-4f7c004ce535 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/44885c2a-525f-4f65-ad9a-1d25e42a93a0" status: 202 len: 0 microversion: 2.1 time: 0.333548 Jul 26 15:42:53.503506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 592/1106] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:42:53 2022] DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments/44885c2a-525f-4f65-ad9a-1d25e42a93a0 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:42:53.658752 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:53.659578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:53.667404 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.668155 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.669374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:53.669976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:53.687702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] HTTP exception thrown: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Request method failure captured: Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 HTTP/1.1 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Ap5erR12nQzR2owLWm5KJnERi3lAZHNdMkOIe880p19rIFGSIjjLiBAJWwROnW5WUcuU6xCdz3LQ9k2yg4ua6lyGW77eWXahuDGWR1-ttDxSqtu_218d7U9MR5cMWFMmLbS0nRNj0GbM4yzi-5BuxoEjsItbFUMFWBvK52H0wlVu10 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:42:53.689498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/3e5dd905492343709b710fabd8a3d24f"}]}] Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-845887562 Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 39f0a10b47b84bd1bd8ff8177362d791 Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:42:53.690997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a3f4641a-1f7d-473c-a239-03183b2ef9b9'} Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:42:53.691835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:42:53.700256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:42:53.701899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Returning 404 to user: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:42:53.701899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-26669e71-3534-47b4-83c2-10003d9f0935 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 404 len: 111 microversion: 2.1 time: 0.037205 Jul 26 15:42:53.701899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 593/1107] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:53 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:42:53.815210 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-582202127", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1871278468", "security_groups": [{"name": "tempest-secgroup-smoke-807363734"}], "block_device_mapping_v2": [{"uuid": "40d1f030-f59c-4740-a667-b87a9ded9732", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80485f05-76b1-4fa2-b061-24e6bca76484"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:53.936864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] validate_networks() for [('80485f05-76b1-4fa2-b061-24e6bca76484', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:42:54.000328 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c20fc87f-0100-468f-9259-14a2bba63ae7 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.334377 Jul 26 15:42:54.001406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 515/1108] 10.222.0.128 () {62 vars in 1369 bytes} [Tue Jul 26 15:42:52 2022] POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments => generated 188 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:42:54.179071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:54.179071 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:54.192762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.193264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:54.194198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.194645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:54.464166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:42:54.469104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:42:54.469104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:42:54.469104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:42:54.469104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:42:54.476245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.476733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:54.477740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.478180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:54.496733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:42:54.500736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for user 39f0a10b47b84bd1bd8ff8177362d791 and project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:42:54.565277 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:42:54.566976 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d1f030-f59c-4740-a667-b87a9ded9732',volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:42:54.951599 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c76146e3-a0f4-400e-bc75-4ba11399959c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments/3ad473c7-48a7-4a64-a0c2-b69d403a1700" status: 202 len: 0 microversion: 2.20 time: 0.778995 Jul 26 15:42:54.955753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 516/1109] 10.222.0.128 () {60 vars in 1462 bytes} [Tue Jul 26 15:42:54 2022] DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments/3ad473c7-48a7-4a64-a0c2-b69d403a1700 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:42:54.961822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7db973d6-e882-4229-b72d-14aa81fc9748"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:54.965419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:54.974178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.976441 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:54.977574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:54.978338 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.081430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:55.104515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-795eb9c5-31a8-484a-9ce5-28d57dc48fbf tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.292482 Jul 26 15:42:55.107371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 594/1110] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:42:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 15:42:55.118310 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:55.120806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.130770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.131734 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.132587 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.133534 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.175381 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-08a99679-c177-4860-9cd4-1f37d44e29c5 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061723 Jul 26 15:42:55.175956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 595/1111] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:42:55 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:42:55.187516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:55.188824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.199288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.199288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.199288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.199288 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.445028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-59b5d228-05d4-4068-aac0-068d30fd67ae tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/action" status: 202 len: 0 microversion: 2.20 time: 0.261813 Jul 26 15:42:55.445631 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 596/1112] 10.222.0.128 () {62 vars in 1324 bytes} [Tue Jul 26 15:42:55 2022] POST /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:55.455214 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-04e5f5b4-eaa1-4232-94dc-59a40d402ff7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:55.456123 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-04e5f5b4-eaa1-4232-94dc-59a40d402ff7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.529828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-04e5f5b4-eaa1-4232-94dc-59a40d402ff7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:55.536659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-04e5f5b4-eaa1-4232-94dc-59a40d402ff7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1097 microversion: 2.1 time: 0.086060 Jul 26 15:42:55.537276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 597/1113] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:55 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1097 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:55.542598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:55.545056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.552592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.553036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.556072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.556072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.589024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e0e1513e-6a9b-4edf-87b8-040f42eb8ba4 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049874 Jul 26 15:42:55.589515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 598/1114] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:42:55 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:42:55.594043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:55.594678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.609169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.609623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.610461 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.610898 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:55.943320 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-48632112-1f85-4aed-908d-5c744e39264a tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "POST /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.973748 Jul 26 15:42:55.947166 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 517/1115] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:42:54 2022] POST /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:55.970716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:55.971310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:55.998399 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:55.999358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.000695 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:56.001365 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.062484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:42:56.293248 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:56.305086 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:56.306685 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:56.308632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cfb21f4e-9bdd-46ba-b085-4d92a8c528cd tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1675 microversion: 2.20 time: 0.718488 Jul 26 15:42:56.336990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 599/1116] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:55 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1675 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:56.454846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8ef66ff0-68ed-4f1f-853e-f0f2bd8ba3de tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 204 len: 0 microversion: 2.1 time: 0.488017 Jul 26 15:42:56.459330 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 518/1117] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:42:55 2022] DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:56.466205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:56.467081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:56.479074 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:56.479532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.480566 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:56.481173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.561290 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:56.562182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:56.573961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:56.576333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.580368 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:56.581477 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:56.676927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:56.690249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0a16e8a1-a7cc-4790-bae9-10fa16326822 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1147 microversion: 2.1 time: 0.134592 Jul 26 15:42:56.691250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 519/1118] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:56 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1147 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:42:56.804082 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:56.812737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c226b4be-0a8d-459d-b5df-f48f69b5d41c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1678 microversion: 2.1 time: 0.352122 Jul 26 15:42:56.813626 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 600/1119] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:56 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:42:57.338937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:57.339461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:57.346309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.346752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.347549 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.347991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.502988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:57.514994 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:57.517118 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:57.519097 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-897b7623-d8d9-4aaf-947f-d16032a70ef5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1675 microversion: 2.20 time: 0.184128 Jul 26 15:42:57.519857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 520/1120] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:57 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:42:57.712480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:57.714605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:57.721259 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.721703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.722653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.723250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.808262 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:57.816793 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-347628a9-f4dd-44c8-b14a-2d78a713b310 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1147 microversion: 2.1 time: 0.108014 Jul 26 15:42:57.828651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 601/1121] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:57 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1147 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:57.835617 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:57.836228 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:57.843716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.844412 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.845211 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:57.845880 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:57.993940 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:58.003499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d6741fa3-9e47-4dcf-be9f-a517dfa4fcce tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1678 microversion: 2.1 time: 0.171855 Jul 26 15:42:58.004288 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 521/1122] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:57 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:58.545582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:58.546745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:58.558398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:58.559216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:58.560316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:58.560934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:58.827873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:58.839238 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:58.840016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:58.842719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:58.847030 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:58.850648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:58.854524 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9ada7df4-92a8-4a7e-9b0f-f6a2388c2a6f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1675 microversion: 2.20 time: 0.313142 Jul 26 15:42:58.856603 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:58.857449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:58.857981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 602/1123] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:58 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1675 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:42:58.860557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:58.861168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.028137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:59.029153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:59.030136 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:59.036019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:59.036652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.037542 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:59.038211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.042530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-78b00204-40b7-4893-a138-16f06ea4fa11 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1195 microversion: 2.1 time: 0.207977 Jul 26 15:42:59.043859 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 522/1124] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:58 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1195 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:59.281788 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:59.289995 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-610e7a1d-2bee-4380-92fb-b8a3ea6403b1 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1678 microversion: 2.1 time: 0.266393 Jul 26 15:42:59.290611 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 603/1125] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:42:59 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:42:59.818532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-4853211d-5bc0-4b72-8a26-266f8be44098 req-1b57e155-66f9-4c60-9511-afb378e1afdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1", "name": "network-vif-deleted", "tag": "d981ff82-1abd-4949-a1c2-fc61aeb64442"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:59.865822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4853211d-5bc0-4b72-8a26-266f8be44098 req-1b57e155-66f9-4c60-9511-afb378e1afdc service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:59.865822 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-4853211d-5bc0-4b72-8a26-266f8be44098 req-1b57e155-66f9-4c60-9511-afb378e1afdc service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.880224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:59.883321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:59.895175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:59.895855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.897377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:59.897784 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:59.951702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-4853211d-5bc0-4b72-8a26-266f8be44098 req-1b57e155-66f9-4c60-9511-afb378e1afdc service nova] Creating event network-vif-deleted:d981ff82-1abd-4949-a1c2-fc61aeb64442 for instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 on hv-cinder-85103 Jul 26 15:42:59.964729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-4853211d-5bc0-4b72-8a26-266f8be44098 req-1b57e155-66f9-4c60-9511-afb378e1afdc service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157588 Jul 26 15:42:59.980181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 523/1126] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:00.068026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:00.069035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:00.093669 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:00.094366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:00.095752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:00.096221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:00.280152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:00.308780 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a338b004-3842-4b9e-8bbb-300c8b9b6bc1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1203 microversion: 2.1 time: 0.238604 Jul 26 15:43:00.309527 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 524/1127] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:00 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:00.327823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:00.333122 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:00.351946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:00.354623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:00.359047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:00.361180 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:00.468168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:00.469950 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:00.470409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:00.470868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lazy-loading 'fault' on Instance uuid 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:43:00.478198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:00.492170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:00.492170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c152d3bf-7f7a-44b1-af39-c4719c08cfd5 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.615894 Jul 26 15:43:00.492770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 604/1128] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:42:59 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:00.546098 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c15511fe433a9278248c528c86e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81499626e98449897622291738f07f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:00.561275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-84c7ac02-3cd9-4f59-a8e6-cd8b2a3d5a8f tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 200 len: 1332 microversion: 2.1 time: 0.242625 Jul 26 15:43:00.561275 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 525/1129] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:00 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 1332 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:01.333501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:01.334121 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:01.348154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.352257 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.353374 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.354174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.518299 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:01.519466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:01.533612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.535891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.538034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.540081 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.671653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:01.680761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cd172ca5-6ebc-4d72-9f46-ca015173e7e7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1280 microversion: 2.1 time: 0.351394 Jul 26 15:43:01.684231 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 605/1130] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:01 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1280 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:01.702061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:01.702987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:01.712397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.713481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.714379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:01.714807 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:01.745370 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 HTTP/1.1 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:01.747009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:01.748699 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1'} Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:01.749597 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:01.751049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:01.752434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:01.752434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ff639c9a-49be-4049-9de7-e1fe8f4e89a2 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 404 len: 111 microversion: 2.1 time: 0.062925 Jul 26 15:43:01.753219 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 606/1131] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:01 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:01.758340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9857c77f-2bcf-4ca6-81b4-80b1b1e977a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '.version_select at 0x7f346ac10430>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:01.883968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9857c77f-2bcf-4ca6-81b4-80b1b1e977a0 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361956165" status: 202 len: 0 microversion: 2.1 time: 0.129601 Jul 26 15:43:01.887032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:01.888969 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 607/1132] 10.222.0.128 () {58 vars in 1226 bytes} [Tue Jul 26 15:43:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361956165 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:43:01.899564 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:01.906297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:01.908234 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ec0d5d5a-f8ee-4508-8bee-9204cdbff509 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.395404 Jul 26 15:43:01.910041 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 526/1133] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:01 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:02.713135 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:02.714948 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:02.736188 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:02.736964 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:02.737953 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:02.738903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:02.941556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:02.944099 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:02.975705 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:02.977633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:02.981484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:02.982061 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:03.272833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:03.293223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fe59a6bd-b383-45d8-9408-ba15a11fc0d3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1280 microversion: 2.1 time: 0.581415 Jul 26 15:43:03.323655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 608/1134] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:02 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1280 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:03.346011 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-0456380c-d85c-49be-a174-d6d82c95348f req-c36815a2-f15a-4752-bf62-e2569708e568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1995e5-37be-4500-aed3-b5e1a2fd0c0a", "tag": "17ca4eda-c8b5-415b-89fb-527bd2c2a98d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:03.383850 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0456380c-d85c-49be-a174-d6d82c95348f req-c36815a2-f15a-4752-bf62-e2569708e568 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:03.389531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0456380c-d85c-49be-a174-d6d82c95348f req-c36815a2-f15a-4752-bf62-e2569708e568 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:03.419043 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-0456380c-d85c-49be-a174-d6d82c95348f req-c36815a2-f15a-4752-bf62-e2569708e568 service nova] Creating event network-changed:17ca4eda-c8b5-415b-89fb-527bd2c2a98d for instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a on hv-cinder-85103 Jul 26 15:43:03.452242 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-0456380c-d85c-49be-a174-d6d82c95348f req-c36815a2-f15a-4752-bf62-e2569708e568 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110034 Jul 26 15:43:03.453314 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 609/1135] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:03.632611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:03.654417 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:03.657773 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:03.663438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bc1bf6c7-0c55-4f57-96fd-c73cbe9514c9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.733130 Jul 26 15:43:03.672356 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 527/1136] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:02 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:04.362074 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:04.369894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:04.574703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:04.574703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:04.574703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:04.574703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:04.579206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:04.696567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:04.698390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:04.707422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:04.708165 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:04.709317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:04.709953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:04.716809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:04.726779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-da5657e0-cc68-474f-bc51-8b0fb1a9cd83 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1280 microversion: 2.1 time: 0.399229 Jul 26 15:43:04.727697 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 610/1137] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:04 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1280 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:05.125937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:05.144643 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:05.151528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:05.158993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b0e3a575-7cc9-4b1c-a42f-7493d28ec163 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.466647 Jul 26 15:43:05.173663 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 528/1138] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:04 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:05.779641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:05.781016 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:05.788833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=8 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:05.809200 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:05.810025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:05.811201 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:05.811972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:06.188100 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:06.191839 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:06.220563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:06.225083 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:06.235569 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:06.238208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:06.523108 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:06.537208 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-259c5b04-d2d0-42d0-b378-b83012017887 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1280 microversion: 2.1 time: 0.780508 Jul 26 15:43:06.538389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 611/1139] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:05 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1280 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:06.742146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:06.769117 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:06.777092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:06.783013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-de2c7023-1ccb-40a9-aef6-22ae3ad35b93 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.598429 Jul 26 15:43:06.784917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 529/1140] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:06 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:06.941570 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:06.943168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:06.956983 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:06.957763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:06.961960 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:06.962700 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:06.981514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:07.144059 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'services' on Instance uuid 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:43:07.387396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3e7362fa-666e-448a-9157-75f7da4a99c4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments/7db973d6-e882-4229-b72d-14aa81fc9748" status: 202 len: 0 microversion: 2.1 time: 0.451735 Jul 26 15:43:07.387994 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 612/1141] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:43:06 2022] DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments/7db973d6-e882-4229-b72d-14aa81fc9748 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:43:07.401137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:07.407572 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:07.450809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.453655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.454504 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.454943 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.475961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:07.476584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:07.484921 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.491954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.497841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.498298 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.517457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-75b4a0b0-427f-41ec-a50b-7bcb94730406 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124551 Jul 26 15:43:07.522164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.522847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 530/1142] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:07 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 HTTP/1.1 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:07.525928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.527725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1'} Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:07.534497 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.536141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.537750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:07.537750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0890ecb2-bbc0-49eb-8ff5-02ddad9ca974 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 404 len: 111 microversion: 2.1 time: 0.059123 Jul 26 15:43:07.537750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 613/1143] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:07 2022] DELETE /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:43:07.547186 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:07.547808 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:07.561279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.567631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.567631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.567631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.581990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.583999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 HTTP/1.1 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:07.584662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.586291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1'} Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:07.587203 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. Jul 26 15:43:07.589087 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:07.590428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:07.591553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:07.592393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-45434736-2756-410e-bb60-6ea32d36557c tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1" status: 404 len: 111 microversion: 2.1 time: 0.052781 Jul 26 15:43:07.597545 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 531/1144] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:07 2022] GET /compute/v2.1/servers/8e7bbedf-719a-42fc-81c0-ffe6af5fb0c1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:07.597683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.597683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.597683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.597683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.812832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:07.813761 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:07.823013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.823580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.824387 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:07.824863 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:07.894341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:08.112625 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:08.136057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-13a71448-b5dd-459d-904c-94865c49d9da tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.557422 Jul 26 15:43:08.137093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 614/1145] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:07 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:08.176684 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:08.179246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:08.180826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:08.182996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-121e6d24-3416-467d-9c0a-cf44423dec3b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.373968 Jul 26 15:43:08.196383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 532/1146] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:07 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:08.533163 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:08.537045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:08.554213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:08.557951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:08.559619 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:08.564810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:08.598932 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f0d154e0-0975-466b-aea4-da55cc7a10a1 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071409 Jul 26 15:43:08.600256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 615/1147] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:08 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:09.002878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:09.012029 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:09.016098 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.016697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.017489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.017927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.033021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 HTTP/1.1 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:09.034619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.037155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '61f25fe8-dfd0-4c65-bb2d-a5dd15567b85'} Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:09.038500 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.052439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.055063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:09.055063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-be925d9c-06d2-408f-8f9b-c45367ce5899 tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 404 len: 111 microversion: 2.1 time: 0.038555 Jul 26 15:43:09.055234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:09.055234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] [instance: 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:09.055430 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 533/1148] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:08 2022] DELETE /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:09.055530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.055530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.055530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.055530 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.069186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] HTTP exception thrown: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Request method failure captured: Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 HTTP/1.1 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am96hWLckaK54lHd7soVvr4EiIDmZ05CCfijmqEvopr9ulw2WIu3Yhpp47JAJF4bcmPBabmqbZifsQEnlIJa7ac19TDSUDaCNieic_ySJkhlESpVp7CsEZAPoUmUhZkMlptFgweSKVAfG-hUzsYAekdTeXCj4hAYm4qSc1zjLVjVSE Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:09.070812 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f81499626e98449897622291738f07f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f81499626e98449897622291738f07f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f81499626e98449897622291738f07f7"}]}] Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f81499626e98449897622291738f07f7 Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1934215454 Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: c2e3c15511fe433a9278248c528c86e0 Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-1934215454-project Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.072859 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '61f25fe8-dfd0-4c65-bb2d-a5dd15567b85'} Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:09.073901 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. Jul 26 15:43:09.075244 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:09.076672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] Returning 404 to user: Instance 61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:09.076672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a5bc5f74-04bf-4f6f-9bdb-f4ee9cd185bd tempest-AttachVolumeTestJSON-1934215454 tempest-AttachVolumeTestJSON-1934215454-project] 10.222.0.128 "GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85" status: 404 len: 111 microversion: 2.1 time: 0.031426 Jul 26 15:43:09.076672 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 616/1149] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:09 2022] GET /compute/v2.1/servers/61f25fe8-dfd0-4c65-bb2d-a5dd15567b85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:09.164190 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:09.166584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:09.178057 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.179192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.180524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.182671 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.211196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:09.213182 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:09.222535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.226745 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.228400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.229032 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.485038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:09.497681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5696824f-efb4-40e3-ba73-fbcae2ed8b32 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.340022 Jul 26 15:43:09.500091 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 534/1150] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:09 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:09.611346 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:09.613907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:09.629398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.632439 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.633561 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:09.636902 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:09.706638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c12112c2-d220-4f1f-b0df-1553079ebcce tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099171 Jul 26 15:43:09.710746 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 535/1151] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:09 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:09.824629 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:09.834035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:09.841651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:09.843299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ab23735e-47d7-4435-aab8-c061cc72aa88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.635999 Jul 26 15:43:09.846246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 617/1152] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:09 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:10.535971 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:10.539765 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:10.599655 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.601759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:10.606478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.610745 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:10.724809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:10.728384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:10.741090 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.745202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:10.747051 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.749071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:10.823071 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eb8e1faf-1b6e-4e90-b77e-501bac76e5a8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103094 Jul 26 15:43:10.826501 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 618/1153] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:10 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:10.873044 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:10.874250 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:10.899329 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.900668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:10.905882 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:10.906605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:11.075514 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:11.087240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-df2df5e1-1a0d-41ae-a1b2-ea38ac9311c6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.568094 Jul 26 15:43:11.088892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 536/1154] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:10 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:11.467923 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:11.479623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:11.490639 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:11.494427 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2dac8392-ca6e-412b-a129-5a829cc1203b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.627070 Jul 26 15:43:11.497897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 619/1155] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:10 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:11.836715 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:11.840571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:11.856718 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:11.857247 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:11.862553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:11.863102 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:11.923621 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9bdc3c67-3a05-42b4-a80f-687e7db34a1f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091106 Jul 26 15:43:11.925916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 537/1156] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:11 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:12.109760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:12.111236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:12.124692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:12.125445 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:12.126421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:12.127021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:12.521554 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:12.522348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:12.535632 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:12.536635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:12.537615 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:12.538301 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:13.072350 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:13.090873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:13.094501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:13.102866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6eae306c-4641-4bab-bf34-b89f1318aa27 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.585578 Jul 26 15:43:13.107893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 538/1157] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:12 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:13.113400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:13.122546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:13.139871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:13.140709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:13.141842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:13.145377 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:13.264987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-04cf9574-925f-4afc-82d5-f5f69ebf8783 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155367 Jul 26 15:43:13.273246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 539/1158] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:13 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:13.748942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:13.762670 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-818a7817-8a16-4dc0-8400-fae024a14ff1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 1.653241 Jul 26 15:43:13.770392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 620/1159] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:12 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:14.146638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:14.146638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:14.158481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.158927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.159702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.160138 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.289352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:14.294590 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:14.309853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:14.313372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.336715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.341338 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.342012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.473677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-24a2241f-457b-4dd1-9749-64e63c2d84b9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.191602 Jul 26 15:43:14.474267 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 621/1160] 10.222.0.128 () {58 vars in 1307 bytes} [Tue Jul 26 15:43:14 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0/os-volume_attachments => generated 25 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:43:14.621489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:14.622442 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:14.645433 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.648939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.648939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:14.648939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:14.678562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:14.699528 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:14.702520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:14.712600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-15ed8237-db20-4de7-a129-3d7d2606eb6d tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.578592 Jul 26 15:43:14.717252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 540/1161] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:14 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:14.736559 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:43:15.093052 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5cc979e9-ee90-4ad1-91d4-7a50269e9f25 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 204 len: 0 microversion: 2.1 time: 0.477881 Jul 26 15:43:15.093646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 622/1162] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:14 2022] DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:43:15.101979 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:15.103032 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:15.124431 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.126351 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.127660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.128326 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.152133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-51454d2b-8c74-410f-af8a-c56066c18cc6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Action: 'create', calling method: .version_select at 0x7f346ac1e550>, body: {"keypair": {"name": "tempest-TestShelveInstance-2093914375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLf+fcaHPKUTXpmdQttVNThdvDRBu+KuYbqTIqrE9L3038uFCteH2lHF/KCwZtMML/CtNGYMpDFB5Zkqw69XkANeBngXvbePwbHv9FuoD4HmIuv4rPiPob7nSFibkM3Dg=="}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:15.204070 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-51454d2b-8c74-410f-af8a-c56066c18cc6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Getting quotas for project f06fcba3614a4f428778ccfa4d2ac3eb. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:43:15.210875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-51454d2b-8c74-410f-af8a-c56066c18cc6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Getting quotas for user e2d108f5b3e64655a62cc6d25255ff87 and project f06fcba3614a4f428778ccfa4d2ac3eb. Resources: {'key_pairs'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:43:15.353366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:15.363307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a21978b0-f19b-452b-9e40-4cb18f9d84b4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.268203 Jul 26 15:43:15.364141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 623/1163] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:15 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:15.370604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:15.372366 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:15.389872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.390512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.391934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.391934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.567668 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:15.577842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1dbcd12e-f80f-449c-88a3-b008a88291e8 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1681 microversion: 2.1 time: 0.212735 Jul 26 15:43:15.578415 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 624/1164] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:15 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:15.583348 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-e19d467d-19c2-4c94-bb34-f76402253643 req-dd21ad62-3633-48f2-b837-00c710e247e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1995e5-37be-4500-aed3-b5e1a2fd0c0a", "name": "network-vif-plugged", "status": "completed", "tag": "17ca4eda-c8b5-415b-89fb-527bd2c2a98d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:15.597083 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e19d467d-19c2-4c94-bb34-f76402253643 req-dd21ad62-3633-48f2-b837-00c710e247e4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.597658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e19d467d-19c2-4c94-bb34-f76402253643 req-dd21ad62-3633-48f2-b837-00c710e247e4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.612069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-e19d467d-19c2-4c94-bb34-f76402253643 req-dd21ad62-3633-48f2-b837-00c710e247e4 service nova] Creating event network-vif-plugged:17ca4eda-c8b5-415b-89fb-527bd2c2a98d for instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a on hv-cinder-85103 Jul 26 15:43:15.617861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-e19d467d-19c2-4c94-bb34-f76402253643 req-dd21ad62-3633-48f2-b837-00c710e247e4 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038207 Jul 26 15:43:15.619949 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 625/1165] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:15.742558 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:15.743714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:15.751522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.751971 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.752804 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:15.753359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:15.921678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:15.932125 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:15.934161 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:15.935362 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-284fa690-ae66-4893-8cc8-fe76c2525b88 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.197869 Jul 26 15:43:15.935916 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 626/1166] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:15 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:16.232522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-51454d2b-8c74-410f-af8a-c56066c18cc6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.513796 Jul 26 15:43:16.233251 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 541/1167] 10.222.0.128 () {60 vars in 1164 bytes} [Tue Jul 26 15:43:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:16.392207 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:16.395870 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:16.406276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.406730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:16.428106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.428106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:16.605917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:16.609105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:16.617714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.619305 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:16.622790 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.623521 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:16.739335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:16.748391 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f6383eae-5971-406d-b51b-e36da6942f05 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.361149 Jul 26 15:43:16.749046 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 627/1168] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:16 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:16.840088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:16.860840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-68fc64c6-601a-4794-bc1f-eb130cacdd91 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1681 microversion: 2.1 time: 0.261956 Jul 26 15:43:16.861531 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 542/1169] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:16 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:16.964675 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:16.968264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:16.986166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.988225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:16.994814 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:16.995741 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:17.022280 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:17.340407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:17.361426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:17.363881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:17.365235 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ded8a21f-7a05-4724-9fab-64b63a35e5fa tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.409818 Jul 26 15:43:17.375225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 628/1170] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:16 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:17.775121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:17.775524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:17.783466 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:17.784909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:17.785730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:17.786390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:17.892772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:17.892772 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:17.905504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:17.905981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:17.906785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:17.907521 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:18.252395 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:18.267451 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ea45276b-735b-4229-b4a5-67e07fc0f846 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1681 microversion: 2.1 time: 0.385091 Jul 26 15:43:18.282936 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 629/1171] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:17 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1681 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:43:18.387938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:18.400047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:18.400047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:18.405336 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:18.405761 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:18.406044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8e9f5014-878c-4f34-b119-5305d3ca68a8 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.638634 Jul 26 15:43:18.407040 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 543/1172] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:17 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:18.425317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:18.436966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:18.733810 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:18.746321 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:18.748434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:18.753063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bd67662d-aeda-45ed-9857-03e323d1c0e8 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.361526 Jul 26 15:43:18.753063 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 630/1173] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:18 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:19.294328 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:19.296137 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:19.325223 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.326379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.329511 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.330280 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.436590 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:19.444413 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-98628cb7-cedc-4edf-b224-ac8cbae82632 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1614 microversion: 2.1 time: 0.157740 Jul 26 15:43:19.445464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:19.447747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:19.456522 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.462368 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 544/1174] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:19 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1614 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:19.465986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.465986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.465986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.770597 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-a9725ae1-aa23-4a2c-877e-ae18f4fe0ada req-b08728ed-3e8d-4a67-97ab-4475e67c8fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba220cc-8230-469c-97f2-4e9dc8a6f7a0", "name": "network-vif-deleted", "tag": "c470964b-1007-4204-8ed3-132f86d700d7"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:19.799835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-a9725ae1-aa23-4a2c-877e-ae18f4fe0ada req-b08728ed-3e8d-4a67-97ab-4475e67c8fd4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.800343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-a9725ae1-aa23-4a2c-877e-ae18f4fe0ada req-b08728ed-3e8d-4a67-97ab-4475e67c8fd4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.843525 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-a9725ae1-aa23-4a2c-877e-ae18f4fe0ada req-b08728ed-3e8d-4a67-97ab-4475e67c8fd4 service nova] Creating event network-vif-deleted:c470964b-1007-4204-8ed3-132f86d700d7 for instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 on hv-cinder-85103 Jul 26 15:43:19.851882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-a9725ae1-aa23-4a2c-877e-ae18f4fe0ada req-b08728ed-3e8d-4a67-97ab-4475e67c8fd4 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085508 Jul 26 15:43:19.857681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 545/1175] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:19.881925 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:19.885116 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:19.887089 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:19.894873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3b83de31-5c73-4a28-9ede-ad61a851612f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1268 microversion: 2.1 time: 0.471004 Jul 26 15:43:19.900652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 631/1176] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:19 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1268 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:19.932269 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.932755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:19.933534 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:19.936638 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:20.242527 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:20.255173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:20.257283 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:20.260035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a96b1741-cce5-4d21-8e91-ad3a93c745f4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.401092 Jul 26 15:43:20.261335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 546/1177] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:19 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:20.476641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:20.480160 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:20.492082 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:20.494313 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:20.497141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:20.497610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:20.592992 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:20.593299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:20.593766 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:43:20.639502 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:20.647327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b03a34cc-fb74-4039-8ad6-299989dbf04d tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1335 microversion: 2.1 time: 0.178039 Jul 26 15:43:20.648053 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 632/1178] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:20 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:20.924183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:20.925160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:20.939226 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:20.940414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:20.941645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:20.942286 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.011109 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-4ccdb85d-4380-48ff-90a8-3fa2140ee825 req-512c36f7-f25a-423e-9a8b-45e3217eac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "name": "network-vif-plugged", "status": "completed", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:21.022724 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4ccdb85d-4380-48ff-90a8-3fa2140ee825 req-512c36f7-f25a-423e-9a8b-45e3217eac6a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.024931 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4ccdb85d-4380-48ff-90a8-3fa2140ee825 req-512c36f7-f25a-423e-9a8b-45e3217eac6a service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.034938 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-4ccdb85d-4380-48ff-90a8-3fa2140ee825 req-512c36f7-f25a-423e-9a8b-45e3217eac6a service nova] Creating event network-vif-plugged:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:43:21.042594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-4ccdb85d-4380-48ff-90a8-3fa2140ee825 req-512c36f7-f25a-423e-9a8b-45e3217eac6a service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Jul 26 15:43:21.043677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 633/1179] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:21.144519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.154911 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-35593f3e-79dc-471c-88ba-44d4e2bed070 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1455 microversion: 2.1 time: 0.234797 Jul 26 15:43:21.156179 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 547/1180] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:20 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1455 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:21.182007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:21.183021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:21.199839 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.200303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.201137 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.213706 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.287734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:21.294478 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:21.329182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.332563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.332563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.332563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.428594 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.438684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fd4e34da-9729-4abb-9def-2aef99a242c9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1455 microversion: 2.1 time: 0.261642 Jul 26 15:43:21.439863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 634/1181] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:21 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1455 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:21.522556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.534048 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.536646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.537310 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-33bf4489-c050-4edc-8697-8afa2f2708a4 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.253767 Jul 26 15:43:21.544103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 548/1182] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:21 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:21.670149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:21.670763 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:21.677909 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.678363 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.679139 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.679641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.720873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:21.721324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:21.722030 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lazy-loading 'fault' on Instance uuid 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:43:21.790236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494aa7af44284866b02f2a295b8b05aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae9a8b5a9ec48f392c43a71f142b102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:21.801941 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-956ffbeb-7a12-4d62-a195-d6ef8f4deff9 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 200 len: 1335 microversion: 2.1 time: 0.135780 Jul 26 15:43:21.804434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 635/1183] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:21 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 1335 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:43:22.569323 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:22.570383 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:22.577951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:22.580798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:22.580798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:22.580798 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:22.743868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:22.754749 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:22.756562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:22.759133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b2152f68-e124-4da0-a3d1-58a2e92fdeda tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.193802 Jul 26 15:43:22.760279 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 549/1184] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:22 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:22.827913 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:22.828507 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:22.835022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:22.835465 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:22.836822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:22.837282 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:22.853553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 HTTP/1.1 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:22.855209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:22.858295 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '1ba220cc-8230-469c-97f2-4e9dc8a6f7a0'} Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:22.859164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:22.860892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:22.863828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:22.863828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f8c4bba4-3fab-4cfb-82a7-2e6ac7d3bb99 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 404 len: 111 microversion: 2.1 time: 0.033015 Jul 26 15:43:22.863828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 636/1185] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:22 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:22.866199 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ec508330-5cc1-48fe-988a-c11036c9eeb6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '.version_select at 0x7f346adccaf0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:22.970627 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ec508330-5cc1-48fe-988a-c11036c9eeb6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898857927" status: 202 len: 0 microversion: 2.1 time: 0.108512 Jul 26 15:43:22.972974 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 550/1186] 10.222.0.128 () {58 vars in 1226 bytes} [Tue Jul 26 15:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898857927 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:43:22.982418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-73c02759-3d28-4810-b925-862597316ee7 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f34734c74c0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:23.041826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-73c02759-3d28-4810-b925-862597316ee7 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/dbb7a75d-021c-474b-819a-4bfd9ed60bd6" status: 200 len: 351 microversion: 2.1 time: 0.063228 Jul 26 15:43:23.050747 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 637/1187] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:43:22 2022] GET /compute/v2.1/os-volumes/dbb7a75d-021c-474b-819a-4bfd9ed60bd6 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:23.757676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-3d87d23c-6bcc-4ea1-8eb4-6a3addd39165 req-62e13956-931b-401f-af3e-010fe93a22c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1995e5-37be-4500-aed3-b5e1a2fd0c0a", "tag": "17ca4eda-c8b5-415b-89fb-527bd2c2a98d"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:23.783636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:23.784881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:23.805808 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:23.808144 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:23.808767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-3d87d23c-6bcc-4ea1-8eb4-6a3addd39165 req-62e13956-931b-401f-af3e-010fe93a22c7 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:23.809780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:23.810460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-3d87d23c-6bcc-4ea1-8eb4-6a3addd39165 req-62e13956-931b-401f-af3e-010fe93a22c7 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:23.816864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:23.848744 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-3d87d23c-6bcc-4ea1-8eb4-6a3addd39165 req-62e13956-931b-401f-af3e-010fe93a22c7 service nova] Creating event network-changed:17ca4eda-c8b5-415b-89fb-527bd2c2a98d for instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a on hv-cinder-85103 Jul 26 15:43:23.880058 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-3d87d23c-6bcc-4ea1-8eb4-6a3addd39165 req-62e13956-931b-401f-af3e-010fe93a22c7 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120835 Jul 26 15:43:23.883339 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 551/1188] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:24.051835 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:24.065939 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:24.070473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:24.070473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-77f35270-2dcc-4656-a418-55c94f440828 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.289394 Jul 26 15:43:24.070473 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 638/1189] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:23 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:43:24.812457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1c34d8f2-91fe-4116-be5f-60ea07808ae6 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346ad40550>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:24.892935 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1c34d8f2-91fe-4116-be5f-60ea07808ae6 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/d792a4a0-0999-494d-bfdf-b89a45257324" status: 200 len: 350 microversion: 2.1 time: 0.084497 Jul 26 15:43:24.893518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 552/1190] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:43:24 2022] GET /compute/v2.1/os-volumes/d792a4a0-0999-494d-bfdf-b89a45257324 => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:25.092930 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:25.093531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:25.100243 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.100726 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.101563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.102023 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.256848 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:25.265802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:25.267368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:25.268686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b3465897-8335-4243-a65e-03220ea5cbe1 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1733 microversion: 2.20 time: 0.179709 Jul 26 15:43:25.269383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 639/1191] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:25 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:25.417709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=4 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:25.421901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:25.423376 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:25.430813 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.432233 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.433034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.433469 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.447634 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 HTTP/1.1 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:25.449841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.451222 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '1ba220cc-8230-469c-97f2-4e9dc8a6f7a0'} Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:25.451991 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.453769 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.455094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:25.455094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e6c79aa2-26f8-4523-ae45-3408e3c9aa8e tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 404 len: 111 microversion: 2.1 time: 0.034603 Jul 26 15:43:25.455094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 553/1192] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:25 2022] DELETE /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:43:25.465831 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:25.466486 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:25.473062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.473552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.474346 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:25.474786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:25.489849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 HTTP/1.1 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:25.491399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.493050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '1ba220cc-8230-469c-97f2-4e9dc8a6f7a0'} Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:25.494648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. Jul 26 15:43:25.496350 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:25.497660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:25.497660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4dd5cef6-bd34-4253-a139-ac6569b3f7f4 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0" status: 404 len: 111 microversion: 2.1 time: 0.032506 Jul 26 15:43:25.497660 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 640/1193] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:25 2022] GET /compute/v2.1/servers/1ba220cc-8230-469c-97f2-4e9dc8a6f7a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:26.293043 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.293703 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:26.301172 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.301631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.302396 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.302827 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.448198 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:26.452016 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=100 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:26.457437 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:26.458928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:26.460092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-72e0e56b-8b36-47cf-896c-a8e75cf81173 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1720 microversion: 2.20 time: 0.172471 Jul 26 15:43:26.460669 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 554/1194] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:43:26.586166 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7434db81-806f-4ba2-9f73-18d0403c1b13 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346ac76700>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.641687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7434db81-806f-4ba2-9f73-18d0403c1b13 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/f1e02ae3-3370-4364-9b23-0f9aca3356bd" status: 200 len: 351 microversion: 2.1 time: 0.059331 Jul 26 15:43:26.642517 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 641/1195] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/os-volumes/f1e02ae3-3370-4364-9b23-0f9aca3356bd => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:26.656930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b6796b3e-0945-4204-8db4-5a10fda77058 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346abc4280>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.744314 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b6796b3e-0945-4204-8db4-5a10fda77058 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092138 Jul 26 15:43:26.744984 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 555/1196] 10.222.0.128 () {58 vars in 1139 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:26.759058 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0c690df8-166a-4ef3-9d6a-d1539fefa779 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f34733b01f0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.791690 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.792259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:26.798707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.799162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.799928 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.800364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.814451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 HTTP/1.1 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:26.815990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.822401 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '81603c0d-50b8-4ca7-8487-8063b5ec69e7'} Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:26.823312 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.824820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.826270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:26.826270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5d87380f-69df-4840-9916-f82c44197705 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 404 len: 111 microversion: 2.1 time: 0.030446 Jul 26 15:43:26.826270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 556/1197] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:26 2022] DELETE /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:43:26.827083 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.827708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 81603c0d-50b8-4ca7-8487-8063b5ec69e7] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:26.833772 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.834184 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.834952 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.835391 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.849512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0c690df8-166a-4ef3-9d6a-d1539fefa779 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094047 Jul 26 15:43:26.850264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 642/1198] 10.222.0.128 () {58 vars in 1154 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 HTTP/1.1 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:26.852945 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.854920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '81603c0d-50b8-4ca7-8487-8063b5ec69e7'} Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:26.855702 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. Jul 26 15:43:26.856924 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.859381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 81603c0d-50b8-4ca7-8487-8063b5ec69e7 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:26.859381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-63e97299-ad6d-4b88-a484-bb675db14013 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7" status: 404 len: 111 microversion: 2.1 time: 0.030698 Jul 26 15:43:26.859381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 557/1199] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/servers/81603c0d-50b8-4ca7-8487-8063b5ec69e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:43:26.862782 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.863349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:26.864573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d17bc9d2-481c-406b-ac88-620b36791e18 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346abdbe50>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.869857 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.870317 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.871104 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.871546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.886383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 HTTP/1.1 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:26.887944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.889610 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '065d4125-a5c9-42f0-aaf7-4c8b7250c221'} Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:26.890538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.892342 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.894178 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:26.894178 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-16561c2d-f5a1-47ce-9883-393670660f9f tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 404 len: 111 microversion: 2.1 time: 0.030442 Jul 26 15:43:26.894178 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 643/1200] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:26 2022] DELETE /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:26.898285 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:26.899005 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 065d4125-a5c9-42f0-aaf7-4c8b7250c221] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:26.906216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.906749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.907599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:26.908110 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:26.922149 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 HTTP/1.1 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:26.924039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.925689 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '065d4125-a5c9-42f0-aaf7-4c8b7250c221'} Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:26.926776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. Jul 26 15:43:26.928398 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:26.933951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 065d4125-a5c9-42f0-aaf7-4c8b7250c221 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:26.933951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3d30c820-6164-46ff-aeff-bf3adf3b7275 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221" status: 404 len: 111 microversion: 2.1 time: 0.031028 Jul 26 15:43:26.933951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 644/1201] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/servers/065d4125-a5c9-42f0-aaf7-4c8b7250c221 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:26.952738 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d17bc9d2-481c-406b-ac88-620b36791e18 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091630 Jul 26 15:43:26.953308 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 558/1202] 10.222.0.128 () {58 vars in 1139 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:26.966893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-42c76e8f-d905-4a96-88c5-a321e44f3b45 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f34734c7820>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:27.055339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-42c76e8f-d905-4a96-88c5-a321e44f3b45 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092759 Jul 26 15:43:27.055909 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 645/1203] 10.222.0.128 () {58 vars in 1172 bytes} [Tue Jul 26 15:43:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:27.069005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-60d48214-5b3f-4473-9a03-a60c31729059 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346ada6670>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:27.154953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-60d48214-5b3f-4473-9a03-a60c31729059 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089697 Jul 26 15:43:27.155524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 559/1204] 10.222.0.128 () {58 vars in 1175 bytes} [Tue Jul 26 15:43:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:27.169561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4c2f6918-2169-4d07-afb1-9cb99f5fef0a tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346ac993a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:27.266087 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4c2f6918-2169-4d07-afb1-9cb99f5fef0a tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100465 Jul 26 15:43:27.266869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 646/1205] 10.222.0.128 () {58 vars in 1160 bytes} [Tue Jul 26 15:43:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:27.281191 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8edaf255-3e4c-43b4-bee8-e9928429a6c5 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346ae39940>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:27.368289 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8edaf255-3e4c-43b4-bee8-e9928429a6c5 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091233 Jul 26 15:43:27.369453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 560/1206] 10.222.0.128 () {58 vars in 1193 bytes} [Tue Jul 26 15:43:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:27.382500 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-20cddd58-ba7c-447e-af01-5fb26e05e543 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] Calling method '.version_select at 0x7f346abe5dc0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:27.468581 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-20cddd58-ba7c-447e-af01-5fb26e05e543 tempest-VolumesTestJSON-1561125578 tempest-VolumesTestJSON-1561125578-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090037 Jul 26 15:43:27.472316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 647/1207] 10.222.0.128 () {58 vars in 1160 bytes} [Tue Jul 26 15:43:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:28.277517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:28.280270 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:28.284700 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:28.285142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:28.285914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:28.286349 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:28.302833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a HTTP/1.1 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:28.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.306662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a'} Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:28.308912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.311656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.315482 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:28.315482 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b59a2b1b-e978-4d21-91fe-d136fc79d2b6 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 404 len: 111 microversion: 2.1 time: 0.033064 Jul 26 15:43:28.315482 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 561/1208] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:43:28 2022] DELETE /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:28.315738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:28.316180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] [instance: 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:28.323225 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:28.323825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:28.324636 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:28.325075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:28.338276 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] HTTP exception thrown: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Request method failure captured: Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a HTTP/1.1 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am8Txlrga7r6M6VHOvjnxElxg_-uTO-vAl68jQr8GLMOT74nponhxWP_70vXyd4odEIsUcZMNY9FXwW-9cmuzBcYMfRof13cATZ1oQMU5RZgDc4nbsV_fHBYrelyC4nBWZA2DegzqF9emDHVMX29-AYEeowoydwWpL454GYT6XPUWQ Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:28.339816 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1ae9a8b5a9ec48f392c43a71f142b102"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1ae9a8b5a9ec48f392c43a71f142b102"}]}] Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1ae9a8b5a9ec48f392c43a71f142b102 Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-665025055 Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 494aa7af44284866b02f2a295b8b05aa Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-665025055-project Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.341678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a'} Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:28.342718 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. Jul 26 15:43:28.344414 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:28.345990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] Returning 404 to user: Instance 5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:28.345990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-836cc351-ca8a-4d05-91e1-de6f8b9bc743 tempest-AttachVolumeNegativeTest-665025055 tempest-AttachVolumeNegativeTest-665025055-project] 10.222.0.128 "GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a" status: 404 len: 111 microversion: 2.1 time: 0.030113 Jul 26 15:43:28.345990 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 648/1209] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:28 2022] GET /compute/v2.1/servers/5f5f99e4-ac11-4b11-b5ee-8ebe23fbd83a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:34.039102 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ff7bff3d-3162-4a8a-a1c3-d9918b3983ab tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Action: 'create', calling method: .version_select at 0x7f346ad40a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1454075731", "metadata": {"Type": "work"}}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ff7bff3d-3162-4a8a-a1c3-d9918b3983ab tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 122 Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:34.050868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1454075731", "metadata": {"Type": "work"}}} Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:43:34.052651 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1454075731', 'metadata': {'Type': 'work'}}}} Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.053686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:43:34.056232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:43:34.057937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:43:34.057937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.057937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ff7bff3d-3162-4a8a-a1c3-d9918b3983ab tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.057937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ff7bff3d-3162-4a8a-a1c3-d9918b3983ab tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.258035 Jul 26 15:43:34.057937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 562/1210] 10.222.0.128 () {60 vars in 1161 bytes} [Tue Jul 26 15:43:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:43:34.064156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95e4b90d-477a-4980-ab38-a761f364f192 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Action: 'create', calling method: .version_select at 0x7f34734c71f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134984176", "metadata": {"Type": "work"}}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95e4b90d-477a-4980-ab38-a761f364f192 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 119 Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:34.068759 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-134984176", "metadata": {"Type": "work"}}} Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: Jul 26 15:43:34.071846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-134984176', 'metadata': {'Type': 'work'}}}} Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi '0' Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.073192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:43:34.074838 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:43:34.076127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:43:34.076127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.076127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95e4b90d-477a-4980-ab38-a761f364f192 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.076127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-95e4b90d-477a-4980-ab38-a761f364f192 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010215 Jul 26 15:43:34.076127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 649/1211] 10.222.0.128 () {60 vars in 1161 bytes} [Tue Jul 26 15:43:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:43:34.082714 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e23ee54-ab4e-401d-aea0-1eb446942e8a tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Action: 'create', calling method: .version_select at 0x7f346abc4280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-891684012", "metadata": {"Type": "work"}}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e23ee54-ab4e-401d-aea0-1eb446942e8a tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 118 Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:34.086442 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-891684012", "metadata": {"Type": "work"}}} Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:43:34.088261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-891684012', 'metadata': {'Type': 'work'}}}} Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi '' Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.089250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:43:34.090750 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:43:34.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:43:34.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0e23ee54-ab4e-401d-aea0-1eb446942e8a tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0e23ee54-ab4e-401d-aea0-1eb446942e8a tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010476 Jul 26 15:43:34.092128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 563/1212] 10.222.0.128 () {60 vars in 1161 bytes} [Tue Jul 26 15:43:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:43:34.100908 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25c2a173-6c16-4620-8a54-7283f161bfe9 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Calling method '.version_select at 0x7f346ac0db80>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:34.133255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-25c2a173-6c16-4620-8a54-7283f161bfe9 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] HTTP exception thrown: Volume tempest-invalid-1167839300 could not be found. Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25c2a173-6c16-4620-8a54-7283f161bfe9 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1167839300 HTTP/1.1 Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:34.135893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Volume tempest-invalid-1167839300 could not be found. Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'tempest-invalid-1167839300'} Jul 26 15:43:34.137356 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1167839300 could not be found. (HTTP 404) (Request-ID: req-22cb469e-4608-4a36-89c5-ed1b1ef5673b) Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.139303 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:43:34.140906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1167839300 could not be found. Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:34.142103 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1167839300 could not be found. Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1167839300 could not be found. Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25c2a173-6c16-4620-8a54-7283f161bfe9 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 404 to user: Volume tempest-invalid-1167839300 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-25c2a173-6c16-4620-8a54-7283f161bfe9 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1167839300" status: 404 len: 99 microversion: 2.1 time: 0.041180 Jul 26 15:43:34.143588 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 650/1213] 10.222.0.128 () {58 vars in 1223 bytes} [Tue Jul 26 15:43:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1167839300 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 15:43:34.153021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-614cbf2a-9d58-438a-a327-a05ce357b64e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004611 Jul 26 15:43:34.153021 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 564/1214] 10.222.0.128 () {58 vars in 1145 bytes} [Tue Jul 26 15:43:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 15:43:34.170335 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b927b50f-45cb-4ff5-b30a-83100c1930d2 tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003819 Jul 26 15:43:34.170824 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 651/1215] 10.222.0.128 () {58 vars in 1142 bytes} [Tue Jul 26 15:43:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 26 15:43:34.179559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f2f275c3-e526-4fb8-a1d1-ed95412fdadc tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Calling method '.version_select at 0x7f346ab4a820>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:34.208129 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-f2f275c3-e526-4fb8-a1d1-ed95412fdadc tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] HTTP exception thrown: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f2f275c3-e526-4fb8-a1d1-ed95412fdadc tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/os-volumes/32ff76c9-7db1-4074-a1d5-e41879af45ef HTTP/1.1 Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:43:34.210114 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '32ff76c9-7db1-4074-a1d5-e41879af45ef'} Jul 26 15:43:34.211753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. (HTTP 404) (Request-ID: req-c6341d1c-3110-4612-9a4c-3f341e3513cc) Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.213252 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:43:34.214613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:43:34.216047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f2f275c3-e526-4fb8-a1d1-ed95412fdadc tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 404 to user: Volume 32ff76c9-7db1-4074-a1d5-e41879af45ef could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.217475 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f2f275c3-e526-4fb8-a1d1-ed95412fdadc tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/32ff76c9-7db1-4074-a1d5-e41879af45ef" status: 404 len: 109 microversion: 2.1 time: 0.035700 Jul 26 15:43:34.222650 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 565/1216] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:43:34 2022] DELETE /compute/v2.1/os-volumes/32ff76c9-7db1-4074-a1d5-e41879af45ef => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:34.233746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-682e8118-2afd-44b5-a9b6-1adf7b7ef63e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Calling method '.version_select at 0x7f34734c79d0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:34.262196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-682e8118-2afd-44b5-a9b6-1adf7b7ef63e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] HTTP exception thrown: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-682e8118-2afd-44b5-a9b6-1adf7b7ef63e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Request method failure captured: Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-volumes/7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a HTTP/1.1 Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AulHjIeI78yp_AYq4INvIsJvemXnDdYqfpzBTucdM2RsByKBbWJQ9jHgcLAH2xVzHwHm-qtTpYUn7q0x6Z3OmRB2U3RJWLxq1gC_a0GKscRB3KElM4kPzchz_XGOnvCFnjWnIGNHsIGRUqFyKX-VSusIEFdaFIwq8Nn49iLkU1FaGM Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:43:34.264112 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/4e23e457e026432eafe2b7f626bef6ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/4e23e457e026432eafe2b7f626bef6ca"}]}] Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 4e23e457e026432eafe2b7f626bef6ca Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-1305833343 Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 097d146673b5420fa24bec096e05fd11 Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-1305833343-project Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a'} Jul 26 15:43:34.265791 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. (HTTP 404) (Request-ID: req-e979627f-3145-4676-8eb7-e2437ce13a4f) Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.266707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:43:34.267861 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:43:34.269226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-682e8118-2afd-44b5-a9b6-1adf7b7ef63e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] Returning 404 to user: Volume 7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-682e8118-2afd-44b5-a9b6-1adf7b7ef63e tempest-VolumesNegativeTest-1305833343 tempest-VolumesNegativeTest-1305833343-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a" status: 404 len: 109 microversion: 2.1 time: 0.036113 Jul 26 15:43:34.270751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 652/1217] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:43:34 2022] GET /compute/v2.1/os-volumes/7f185fa3-aea1-4ca9-a8e3-f13bbff49e0a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:43:38.431152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:38.436088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=6 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:38.436088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1495533810", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2093914375", "security_groups": [{"name": "tempest-secgroup-smoke-899575915"}], "networks": [{"uuid": "17c20447-2fba-40df-9a90-b0346ebd5704"}], "block_device_mapping_v2": [{"uuid": "7d977eb1-30a9-438a-ad19-67a4bce04260", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:38.558748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.network.neutron [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] validate_networks() for [('17c20447-2fba-40df-9a90-b0346ebd5704', None, None, None, None, None)] {{(pid=124842) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:43:38.954048 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Flavor limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:43:38.954538 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Image limits 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:43:38.955128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Flavor pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:43:38.955648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Image pref 0:0:0 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:43:38.956117 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.virt.hardware [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124842) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:43:38.965254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:38.965774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:38.966686 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:38.967264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:38.986608 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Getting quotas for project f06fcba3614a4f428778ccfa4d2ac3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:43:38.990629 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.quota [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Getting quotas for user e2d108f5b3e64655a62cc6d25255ff87 and project f06fcba3614a4f428778ccfa4d2ac3eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124842) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:43:39.070962 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Going to run 1 instances... {{(pid=124842) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:43:39.073416 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d977eb1-30a9-438a-ad19-67a4bce04260',volume_size=None,volume_type=None)] {{(pid=124842) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:43:39.543613 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [517aef1e-12be-424d-a008-8e3e2b06626d] AMQP server on 10.222.0.128:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:43:40.552611 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [517aef1e-12be-424d-a008-8e3e2b06626d] Reconnected to AMQP server on 10.222.0.128:5672 via [amqp] client with port 54048. Jul 26 15:43:40.555359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6dbe094e-be63-4927-877e-d5c223b4096a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.125778 Jul 26 15:43:40.556015 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 566/1218] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:43:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:43:40.564955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:40.565809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=67 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:40.573832 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-80bb5171-7cd0-4d04-9f99-723b63dcf94e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:40.574582 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-80bb5171-7cd0-4d04-9f99-723b63dcf94e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:40.630054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-80bb5171-7cd0-4d04-9f99-723b63dcf94e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:40.638646 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-80bb5171-7cd0-4d04-9f99-723b63dcf94e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1092 microversion: 2.1 time: 0.075385 Jul 26 15:43:40.639221 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 653/1219] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:40 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:41.662820 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3ea19d80-19a6-4db5-b6f3-a5e927f2af3d tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:41.663732 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3ea19d80-19a6-4db5-b6f3-a5e927f2af3d tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:41.750046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3ea19d80-19a6-4db5-b6f3-a5e927f2af3d tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:41.759846 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3ea19d80-19a6-4db5-b6f3-a5e927f2af3d tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1092 microversion: 2.1 time: 0.101274 Jul 26 15:43:41.765010 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 567/1220] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:41 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1092 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:42.792632 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:42.793237 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:42.801434 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:42.801937 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:42.803020 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:42.803562 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:42.878683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:42.889466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-39a4c221-33a7-43b4-a324-1374896878f2 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1190 microversion: 2.1 time: 0.099286 Jul 26 15:43:42.889466 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 654/1221] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:42 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:43.913414 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:43.915868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:43.926448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:43.926906 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:43.927875 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:43.928578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:44.008593 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:44.017171 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f27f81d4-558e-42df-92df-ecafce91ff4e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1208 microversion: 2.1 time: 0.108422 Jul 26 15:43:44.017754 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 568/1222] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:43 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1208 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:45.041055 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:45.043364 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:45.052193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:45.052895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:45.053895 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:45.054584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:45.217682 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:45.228101 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6bb4929e-e83f-4509-8f42-dd54f456bd06 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.192703 Jul 26 15:43:45.229416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 655/1223] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:45 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:45.252938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-d7a6cd92-b1d7-4050-b14b-3f6b851aa426 req-88cf347d-2c18-4fb1-b1cc-18db9f3c13dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:45.266464 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-d7a6cd92-b1d7-4050-b14b-3f6b851aa426 req-88cf347d-2c18-4fb1-b1cc-18db9f3c13dd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:45.266916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-d7a6cd92-b1d7-4050-b14b-3f6b851aa426 req-88cf347d-2c18-4fb1-b1cc-18db9f3c13dd service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:45.285953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-d7a6cd92-b1d7-4050-b14b-3f6b851aa426 req-88cf347d-2c18-4fb1-b1cc-18db9f3c13dd service nova] Creating event network-changed:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:43:45.295796 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-d7a6cd92-b1d7-4050-b14b-3f6b851aa426 req-88cf347d-2c18-4fb1-b1cc-18db9f3c13dd service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046724 Jul 26 15:43:45.297011 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 569/1224] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:43:46.250440 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:46.251069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:46.257715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:46.259371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:46.260407 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:46.261072 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:46.478454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:46.486595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3b97687a-31d9-4f76-a6c5-1b4fb9e10152 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.240812 Jul 26 15:43:46.487168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 656/1225] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:46 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:47.509689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:47.511147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:47.518559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:47.518559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:47.519214 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:47.519662 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:47.678694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:47.690277 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3f4742f2-5dd6-415e-8b21-aa6ec1b09812 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.186037 Jul 26 15:43:47.690990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 570/1226] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:47 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:48.723175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:48.723822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:48.731247 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:48.731767 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:48.732491 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:48.732944 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:49.143051 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:49.153823 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0cffaaa9-fb0a-4800-8487-4d3fa8a45832 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.434471 Jul 26 15:43:49.154413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 657/1227] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:48 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:50.177628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:50.178863 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:50.182027 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:50.187390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:50.191694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:50.191694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:50.191694 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:50.354708 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:50.363094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f4c95e1c-39c1-4fa5-a95a-80af881dcb39 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.189370 Jul 26 15:43:50.363841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 571/1228] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:50 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:51.387806 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:51.388416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:51.390853 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:51.395928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:51.396506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:51.397348 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:51.397984 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:51.570687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:51.579041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d3ed9fef-3335-4e2b-bd1d-d62a3d228ee9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.196021 Jul 26 15:43:51.579648 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 658/1229] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:51 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:52.600759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:52.601553 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:52.604183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=8 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:43:52.609276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:52.609804 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:52.610652 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:52.611163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:52.813188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:52.821530 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-27655726-c3a1-428c-9dcd-bbdf5aa877e8 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.224882 Jul 26 15:43:52.822116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 572/1230] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:52 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:53.843174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:53.843785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:53.850496 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:53.850950 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:53.855516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:53.855516 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:54.032569 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:54.041647 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cf6a546a-8053-489c-8554-e89847946718 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.202596 Jul 26 15:43:54.042234 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 659/1231] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:53 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:55.063835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:55.064457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:55.072567 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:55.073007 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:55.076162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:55.076162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:55.231628 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-e7b3c6d3-3c9c-402e-9615-48c39276c56f req-65444a82-1e25-4f9f-b6e1-053029d08555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "name": "network-vif-plugged", "status": "completed", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:43:55.236951 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:55.241955 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e7b3c6d3-3c9c-402e-9615-48c39276c56f req-65444a82-1e25-4f9f-b6e1-053029d08555 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:55.242416 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e7b3c6d3-3c9c-402e-9615-48c39276c56f req-65444a82-1e25-4f9f-b6e1-053029d08555 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:55.248699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6c0c05e8-e0df-428a-b71c-74a9228cab38 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.189211 Jul 26 15:43:55.251306 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 573/1232] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:55 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:55.257174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-e7b3c6d3-3c9c-402e-9615-48c39276c56f req-65444a82-1e25-4f9f-b6e1-053029d08555 service nova] Creating event network-vif-plugged:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:43:55.263604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-e7b3c6d3-3c9c-402e-9615-48c39276c56f req-65444a82-1e25-4f9f-b6e1-053029d08555 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037049 Jul 26 15:43:55.264651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 660/1233] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:43:56.273967 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:56.274781 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:56.282481 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:56.282818 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:56.283659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:56.284200 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:56.438595 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:56.446505 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5a53a054-3f72-4b0e-8743-f23854c95f1c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1263 microversion: 2.1 time: 0.177169 Jul 26 15:43:56.447215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 574/1234] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:56 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:57.470817 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:57.472114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:57.478552 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:57.483300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:57.483300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:57.483300 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:57.640078 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:57.658740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-19a128f3-0b84-4e1f-923c-7d2d61735bb9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1447 microversion: 2.1 time: 0.192553 Jul 26 15:43:57.661951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 661/1235] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:57 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:43:57.684092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:43:57.684723 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:43:57.691937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:57.692704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:57.693532 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:43:57.694120 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:43:57.877375 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:43:57.886241 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b821a051-2afc-4e03-b8be-2fd875c843a9 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1447 microversion: 2.1 time: 0.206738 Jul 26 15:43:57.886811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 575/1236] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:43:57 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1447 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:44:00.155709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-101ceee4-647f-4803-b956-20afee89b0b3 req-96e5c884-1b80-4879-a0ad-d87bed3e43c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:44:00.165962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-101ceee4-647f-4803-b956-20afee89b0b3 req-96e5c884-1b80-4879-a0ad-d87bed3e43c8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:00.166654 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-101ceee4-647f-4803-b956-20afee89b0b3 req-96e5c884-1b80-4879-a0ad-d87bed3e43c8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:00.178341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-101ceee4-647f-4803-b956-20afee89b0b3 req-96e5c884-1b80-4879-a0ad-d87bed3e43c8 service nova] Creating event network-changed:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:44:00.183327 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-101ceee4-647f-4803-b956-20afee89b0b3 req-96e5c884-1b80-4879-a0ad-d87bed3e43c8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 Jul 26 15:44:00.184307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 662/1237] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:04.735441 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:04.737676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:04.745426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:04.750046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:04.750046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:04.750046 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:04.777418 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d1b63f14-11c3-4c64-8f96-d49b49c4d73b tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045996 Jul 26 15:44:04.777986 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 576/1238] 10.222.0.128 () {60 vars in 1348 bytes} [Tue Jul 26 15:44:04 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:44:04.852733 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:04.853371 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:04.859961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:04.860399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:04.861503 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:04.862165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:04.889531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:44:05.256226 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f3d1d671-f32a-4ae7-aff9-c6f707c5cf4f tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 204 len: 0 microversion: 2.20 time: 0.408753 Jul 26 15:44:05.258176 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 663/1239] 10.222.0.128 () {60 vars in 1285 bytes} [Tue Jul 26 15:44:04 2022] DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:44:05.269996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:05.269996 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:05.275554 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:05.276156 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:05.277299 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:05.277901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:05.424499 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:05.434332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:05.435885 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:05.437320 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e143ea6e-3895-4d8e-979b-11b5f11589be tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.173739 Jul 26 15:44:05.437893 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 577/1240] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:05 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:44:06.463780 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:06.464904 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:06.471169 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:06.471603 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:06.472302 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:06.472821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:06.611396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:06.620403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:06.621940 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:06.623127 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9a701ac4-c274-4cf5-bc0e-36a314932383 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1726 microversion: 2.20 time: 0.165604 Jul 26 15:44:06.623686 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 664/1241] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:06 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:44:07.657431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:07.658492 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:07.680428 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:07.681582 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:07.686648 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:07.687536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:07.777276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:07.785693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:07.787208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2e9553297c842b3a3c308cdd09aad8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1165baf67df0484dbe4163c5a750784a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:44:07.788507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8518eaac-b347-487d-95e0-e27f1fcf6725 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 200 len: 1658 microversion: 2.20 time: 0.144750 Jul 26 15:44:07.789710 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 578/1242] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:07 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 1658 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:44:07.971485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b9e2b8bc-350a-4c7e-8585-f9ee35ddbaff req-65597643-d6d5-4aa1-b290-7f6a47610eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3762cd-d549-4fd9-bff1-908c9b1f40f1", "name": "network-vif-deleted", "tag": "a738a47a-b442-4106-adbb-9f2d80950686"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:44:07.986105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b9e2b8bc-350a-4c7e-8585-f9ee35ddbaff req-65597643-d6d5-4aa1-b290-7f6a47610eaf service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:07.986553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b9e2b8bc-350a-4c7e-8585-f9ee35ddbaff req-65597643-d6d5-4aa1-b290-7f6a47610eaf service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:07.999846 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b9e2b8bc-350a-4c7e-8585-f9ee35ddbaff req-65597643-d6d5-4aa1-b290-7f6a47610eaf service nova] Creating event network-vif-deleted:a738a47a-b442-4106-adbb-9f2d80950686 for instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 on hv-cinder-85103 Jul 26 15:44:08.005241 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b9e2b8bc-350a-4c7e-8585-f9ee35ddbaff req-65597643-d6d5-4aa1-b290-7f6a47610eaf service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037538 Jul 26 15:44:08.005849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 665/1243] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:08.813359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:08.815141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:08.822634 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:08.823254 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:08.824217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:08.824864 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:08.829511 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=65 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:08.839821 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 HTTP/1.1 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:44:08.842258 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:08.844665 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '1c3762cd-d549-4fd9-bff1-908c9b1f40f1'} Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:08.845497 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:08.848728 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:08.851139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:08.851139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0222e3e4-23d3-4f1b-a062-9a10273bc073 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 404 len: 111 microversion: 2.20 time: 0.033672 Jul 26 15:44:08.851139 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 579/1244] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:08 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:44:08.853650 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0b0a456e-4acd-42c2-86f6-b25ba7da2188 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '.version_select at 0x7f346ac0da60>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:08.948851 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0b0a456e-4acd-42c2-86f6-b25ba7da2188 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126455409" status: 204 len: 0 microversion: 2.20 time: 0.100231 Jul 26 15:44:08.949578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 666/1245] 10.222.0.128 () {60 vars in 1267 bytes} [Tue Jul 26 15:44:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126455409 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 15:44:11.140244 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:11.141378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:11.142921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:11.147716 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:11.148166 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:11.149630 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:11.150067 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:11.163891 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 HTTP/1.1 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:44:11.165680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.167431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '1c3762cd-d549-4fd9-bff1-908c9b1f40f1'} Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:11.168501 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.170378 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.172002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:11.172002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-746e324b-e195-43e4-b3b5-96e37321f9e9 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 404 len: 111 microversion: 2.20 time: 0.031001 Jul 26 15:44:11.172002 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 580/1246] 10.222.0.128 () {60 vars in 1285 bytes} [Tue Jul 26 15:44:11 2022] DELETE /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:44:11.176494 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:11.177228 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 1c3762cd-d549-4fd9-bff1-908c9b1f40f1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:11.184150 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:11.184641 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:11.185419 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:11.185863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:11.199684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 HTTP/1.1 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:44:11.201408 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.203158 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '1c3762cd-d549-4fd9-bff1-908c9b1f40f1'} Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:11.203998 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. Jul 26 15:44:11.205333 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:11.206528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 1c3762cd-d549-4fd9-bff1-908c9b1f40f1 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:11.206528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-327f90a9-c8dc-4af5-aa72-59d2f1794d68 tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1" status: 404 len: 111 microversion: 2.20 time: 0.030678 Jul 26 15:44:11.206528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 667/1247] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:11 2022] GET /compute/v2.1/servers/1c3762cd-d549-4fd9-bff1-908c9b1f40f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 15:44:12.521215 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:12.524833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:12.529341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:12.529792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:12.530556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:12.531092 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:12.545600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 HTTP/1.1 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:44:12.547163 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.548899 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '466faeda-8564-46cd-a893-141a3ed7e409'} Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:12.549874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.551398 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.552901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:12.552901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f4ed5d72-f9ce-4ef0-9691-ac954193bbba tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 404 len: 111 microversion: 2.20 time: 0.031376 Jul 26 15:44:12.552901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 581/1248] 10.222.0.128 () {60 vars in 1285 bytes} [Tue Jul 26 15:44:12 2022] DELETE /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:44:12.571776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:12.571776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] [instance: 466faeda-8564-46cd-a893-141a3ed7e409] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:44:12.571776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:12.571776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:12.572525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:44:12.572525 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:44:12.583875 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] HTTP exception thrown: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Request method failure captured: Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 HTTP/1.1 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Am7zMLGcZPyUZiWq3fVQ646NR4HymhV4zKpXTWPoAzCDyXrVFHIGk2cKaKSxtZe9aTpZMYtb9rN0b3vrJ5Op9GaTVdsQ3z_W8cxwRpk-Wrsy2rcvmizx7nsGIyO7AeGrXdlLGLqbnYxhBSd6n6nBmKULkPoO3OUEygZRkIDXtBuBZc Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:44:12.585444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_1165baf67df0484dbe4163c5a750784a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/1165baf67df0484dbe4163c5a750784a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/1165baf67df0484dbe4163c5a750784a"}]}] Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 1165baf67df0484dbe4163c5a750784a Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-762133587 Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: e2e9553297c842b3a3c308cdd09aad8d Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-762133587-project Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.587924 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '466faeda-8564-46cd-a893-141a3ed7e409'} Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:12.593758 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. Jul 26 15:44:12.595281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:44:12.596707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] Returning 404 to user: Instance 466faeda-8564-46cd-a893-141a3ed7e409 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:12.596707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-92d56d23-f1da-4093-a2c9-df3a52cf171c tempest-AttachVolumeShelveTestJSON-762133587 tempest-AttachVolumeShelveTestJSON-762133587-project] 10.222.0.128 "GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409" status: 404 len: 111 microversion: 2.20 time: 0.033474 Jul 26 15:44:12.596707 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 668/1249] 10.222.0.128 () {60 vars in 1282 bytes} [Tue Jul 26 15:44:12 2022] GET /compute/v2.1/servers/466faeda-8564-46cd-a893-141a3ed7e409 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:44:19.162303 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4674eff7-de53-4180-999e-01b42212815e tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Action: 'create', calling method: .version_select at 0x7f346ada6ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1052305542", "metadata": {"Type": "work"}}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:44:19.800998 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4674eff7-de53-4180-999e-01b42212815e tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.758040 Jul 26 15:44:19.801697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 582/1250] 10.222.0.128 () {60 vars in 1161 bytes} [Tue Jul 26 15:44:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 760 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 26 15:44:19.815077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-68894b44-1bb8-419a-8a24-3cf99b7ec79f tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346b4d0280>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:19.869428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-68894b44-1bb8-419a-8a24-3cf99b7ec79f tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 353 microversion: 2.1 time: 0.057921 Jul 26 15:44:19.870084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 669/1251] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:19 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:20.884152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-34d987c2-e66a-432b-8d76-d8668ef3e9f7 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346aca8f70>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:20.947209 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-34d987c2-e66a-432b-8d76-d8668ef3e9f7 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 354 microversion: 2.1 time: 0.067843 Jul 26 15:44:20.947774 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 583/1252] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:20 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:20.961757 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0e81a2ab-d789-45c1-bd3a-17ca90ad23bb tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346acb2d30>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:21.014033 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0e81a2ab-d789-45c1-bd3a-17ca90ad23bb tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 354 microversion: 2.1 time: 0.057475 Jul 26 15:44:21.014634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 670/1253] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:20 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:21.032833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5091bd09-431d-4d4d-88ba-2b6ced53fe19 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346aca2430>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:21.217031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5091bd09-431d-4d4d-88ba-2b6ced53fe19 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "DELETE /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 202 len: 0 microversion: 2.1 time: 0.187665 Jul 26 15:44:21.220900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 584/1254] 10.222.0.128 () {58 vars in 1253 bytes} [Tue Jul 26 15:44:21 2022] DELETE /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:44:21.225987 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1f9eec76-0dbd-4335-9540-cbcb0fc97688 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346acb2ca0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:21.276709 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1f9eec76-0dbd-4335-9540-cbcb0fc97688 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 353 microversion: 2.1 time: 0.054405 Jul 26 15:44:21.277290 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 671/1255] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:21 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:22.291160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8a440352-3b1a-48d8-9e2e-167a11ee5853 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346a962040>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:22.340908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8a440352-3b1a-48d8-9e2e-167a11ee5853 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 353 microversion: 2.1 time: 0.054817 Jul 26 15:44:22.341484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 585/1256] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:22 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:23.353790 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:23.354553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:23.359424 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-83d2566d-d137-428b-b25e-65873492f133 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346b4de820>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:23.407146 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-83d2566d-d137-428b-b25e-65873492f133 tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 200 len: 353 microversion: 2.1 time: 0.055064 Jul 26 15:44:23.407740 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 672/1257] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:23 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:44:24.417781 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=5 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:44:24.422405 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2ea503fa-ae91-4c58-8595-c574846863ce tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Calling method '.version_select at 0x7f346ada6af0>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:44:24.461631 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-2ea503fa-ae91-4c58-8595-c574846863ce tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] HTTP exception thrown: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2ea503fa-ae91-4c58-8595-c574846863ce tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Request method failure captured: Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 HTTP/1.1 Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4AvSHaW2YRZILbdIUVHoybUgq1VAshRx3HfvfHHbQwFwGS4jF2TAsOHGTaqh-3z1XlWRgpy7M3jHI_fezljb_2V55d4DknCzWVzlKIkUm5-MLfCoFTX9XlExNBChkOHqL85iivdxt2aJaWqGPPbn6LdWVWNewB4mlnkh6MIVE1qqYko Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: fa7926ba1045431c965f03c2d15b319b Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-VolumesGetTestJSON-139249327 Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:44:24.463829 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/fa7926ba1045431c965f03c2d15b319b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_fa7926ba1045431c965f03c2d15b319b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/fa7926ba1045431c965f03c2d15b319b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/fa7926ba1045431c965f03c2d15b319b"}]}] Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-VolumesGetTestJSON-139249327 Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: fa7926ba1045431c965f03c2d15b319b Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-VolumesGetTestJSON-139249327 Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-VolumesGetTestJSON-139249327-project Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: dcadd748cf354d6cb75dbe9942d6de29 Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-VolumesGetTestJSON-139249327-project Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '2b628021-efe8-4cf6-a6c5-6f935dc2ba03'} Jul 26 15:44:24.467105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. (HTTP 404) (Request-ID: req-97d8fe9a-f13f-45cb-a3ba-e691e9e5f2e4) Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:24.468575 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:44:24.469856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:44:24.471194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2ea503fa-ae91-4c58-8595-c574846863ce tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] Returning 404 to user: Volume 2b628021-efe8-4cf6-a6c5-6f935dc2ba03 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2ea503fa-ae91-4c58-8595-c574846863ce tempest-VolumesGetTestJSON-139249327 tempest-VolumesGetTestJSON-139249327-project] 10.222.0.128 "GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03" status: 404 len: 109 microversion: 2.1 time: 0.048646 Jul 26 15:44:24.472814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 586/1258] 10.222.0.128 () {58 vars in 1250 bytes} [Tue Jul 26 15:44:24 2022] GET /compute/v2.1/os-volumes/2b628021-efe8-4cf6-a6c5-6f935dc2ba03 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:45:18.663345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1982278553", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1871278468", "security_groups": [{"name": "tempest-secgroup-smoke-807363734"}], "block_device_mapping_v2": [{"uuid": "e6d4d291-6042-4f74-b784-0b86971ffd2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80485f05-76b1-4fa2-b061-24e6bca76484"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:18.930049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] validate_networks() for [('80485f05-76b1-4fa2-b061-24e6bca76484', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:45:19.401888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:45:19.401888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:45:19.401888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:45:19.401888 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:45:19.402334 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:45:19.412603 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:19.412981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:19.413795 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:19.414230 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:19.435368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:45:19.440776 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Getting quotas for user 39f0a10b47b84bd1bd8ff8177362d791 and project 3e5dd905492343709b710fabd8a3d24f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:45:19.500448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:45:19.502561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6d4d291-6042-4f74-b784-0b86971ffd2c',volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:45:19.880187 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-64f86fd1-db7f-4d1f-a6eb-04b7d70135a6 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.222945 Jul 26 15:45:19.881057 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 673/1259] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:45:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:45:19.889916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:19.894322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-bf335d31-4603-45cf-81ea-b79211785f89 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:19.895051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-bf335d31-4603-45cf-81ea-b79211785f89 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:20.092111 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-bf335d31-4603-45cf-81ea-b79211785f89 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:20.100152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-bf335d31-4603-45cf-81ea-b79211785f89 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1098 microversion: 2.1 time: 0.211726 Jul 26 15:45:20.100759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 587/1260] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:19 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1098 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:21.121599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:21.122252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:21.129140 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:21.129585 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:21.130345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:21.130778 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:21.192165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:21.199903 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-36783693-2f76-474f-a3d6-b625a3f7ffa5 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1148 microversion: 2.1 time: 0.082852 Jul 26 15:45:21.200490 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 674/1261] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:21 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1148 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:22.221512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:22.222153 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:22.229626 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:22.230766 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:22.231586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:22.232045 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:22.295393 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:22.303771 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8b38df74-e70c-475c-b6b2-068f1395ec78 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1196 microversion: 2.1 time: 0.087024 Jul 26 15:45:22.304357 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 588/1262] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:22 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1196 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:23.324957 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:23.325550 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:23.332730 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:23.340318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:23.340318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:23.340318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:23.402805 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:23.410926 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f0dc3c99-6a75-4e32-9e4c-91cc8f0cf694 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1214 microversion: 2.1 time: 0.090081 Jul 26 15:45:23.411488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 675/1263] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:23 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:45:23.673633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:45:23.673633 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:45:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:45:24.438030 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:24.439111 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:24.445985 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:24.446472 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:24.450681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:24.450681 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:24.534156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-541281e1-398e-4b60-9c64-ea5cce71fa8e req-64471d6d-4598-41a1-90f5-dddecd730a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7719e4-b29e-45da-9e1d-ecd82e9a055d", "tag": "dd5052d4-4623-4d6e-bc77-6881107cc267"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:24.545876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-541281e1-398e-4b60-9c64-ea5cce71fa8e req-64471d6d-4598-41a1-90f5-dddecd730a0f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:24.546324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-541281e1-398e-4b60-9c64-ea5cce71fa8e req-64471d6d-4598-41a1-90f5-dddecd730a0f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:24.571384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-541281e1-398e-4b60-9c64-ea5cce71fa8e req-64471d6d-4598-41a1-90f5-dddecd730a0f service nova] Creating event network-changed:dd5052d4-4623-4d6e-bc77-6881107cc267 for instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d on hv-cinder-85103 Jul 26 15:45:24.576779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-541281e1-398e-4b60-9c64-ea5cce71fa8e req-64471d6d-4598-41a1-90f5-dddecd730a0f service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047171 Jul 26 15:45:24.577683 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 676/1264] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:45:24.727066 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:24.740792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b72dedc2-0947-4ccb-a081-fc3917904892 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.306853 Jul 26 15:45:24.745055 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 589/1265] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:24 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:25.769847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:25.770584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:25.777022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:25.777512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:25.778283 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:25.778738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:25.922444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:25.930186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bcc2b54c-df2a-42b6-af91-aa6d0af64f1d tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.165372 Jul 26 15:45:25.938488 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 677/1266] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:25 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:26.950661 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:26.951276 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:26.958693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:26.959224 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:26.959892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:26.960343 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:27.098047 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:27.105763 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4d1b5667-c220-4f1f-84b2-18fb98ef9135 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.159055 Jul 26 15:45:27.106324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 590/1267] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:26 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:28.126378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:28.126925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:28.133592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:28.134045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:28.134821 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:28.135252 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:28.275678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:28.284624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a90bd6ae-8f0b-4ac8-b96d-4fa5b8cc1b39 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.162318 Jul 26 15:45:28.295077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 678/1268] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:28 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:29.307390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:29.308000 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:29.314457 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:29.314903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:29.315668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:29.316103 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:29.455197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:29.463044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0eb5fbc6-c336-44e7-abb9-d1dfcc3f0ea7 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.159716 Jul 26 15:45:29.463860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 591/1269] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:29 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:30.485553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:30.486170 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:30.488715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:30.489385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:30.494389 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:30.494907 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:30.495715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:30.496154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:30.639316 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:30.649546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6b54f6e6-e723-4060-a7ba-926415923947 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.168755 Jul 26 15:45:30.650132 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 679/1270] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:30 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:31.673194 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:31.674182 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:31.676147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:31.687562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:31.688427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:31.689423 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:31.689860 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:31.861461 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:31.871660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d2082557-5703-45aa-977c-88f07eb3a448 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.202626 Jul 26 15:45:31.872409 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 592/1271] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:31 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:32.897318 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:32.898012 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:32.905345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:32.906399 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:32.907193 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:32.907753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:33.074004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:33.085655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-97e9b043-68a4-4354-bc19-fccf3bf0e48e tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.192231 Jul 26 15:45:33.086249 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 680/1272] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:32 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:34.106937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:34.107496 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:34.115026 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:34.115480 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:34.116324 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:34.116802 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:34.268573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:34.277675 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3ca1ccb9-1712-49c3-bfda-6ae6be667753 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.174770 Jul 26 15:45:34.279857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 593/1273] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:34 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:35.301655 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:35.302268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:35.310377 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:35.310962 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:35.312264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:35.312738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:35.456432 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:35.464444 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f8eb5728-cd64-4cc0-98ff-b78578921101 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.166763 Jul 26 15:45:35.465047 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 681/1274] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:35 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:45:35.912241 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-78962b3f-df94-42ef-bab2-2bbc51a122eb req-3b400341-f961-4d52-b2b5-c8d10859b235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7719e4-b29e-45da-9e1d-ecd82e9a055d", "name": "network-vif-plugged", "status": "completed", "tag": "dd5052d4-4623-4d6e-bc77-6881107cc267"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:35.923949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-78962b3f-df94-42ef-bab2-2bbc51a122eb req-3b400341-f961-4d52-b2b5-c8d10859b235 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:35.924394 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-78962b3f-df94-42ef-bab2-2bbc51a122eb req-3b400341-f961-4d52-b2b5-c8d10859b235 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:35.936199 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-78962b3f-df94-42ef-bab2-2bbc51a122eb req-3b400341-f961-4d52-b2b5-c8d10859b235 service nova] Creating event network-vif-plugged:dd5052d4-4623-4d6e-bc77-6881107cc267 for instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d on hv-cinder-85103 Jul 26 15:45:35.941983 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-78962b3f-df94-42ef-bab2-2bbc51a122eb req-3b400341-f961-4d52-b2b5-c8d10859b235 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Jul 26 15:45:35.949249 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 594/1275] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:45:36.174694 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-982791418", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "networks": [{"uuid": "d9462f87-b3b2-4fe2-af52-0b7bb7bb32a4"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:36.229973 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] validate_networks() for [('d9462f87-b3b2-4fe2-af52-0b7bb7bb32a4', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:45:36.486245 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:36.487057 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:36.493484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:36.493927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:36.494689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:36.495127 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:36.606206 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:45:36.606687 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:45:36.607114 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:45:36.607571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:45:36.607978 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:45:36.618070 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:36.618520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:36.619312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:36.619748 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:36.632257 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:36.637000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Getting quotas for project c3d0ec4c669b4f6d8bc80aa8d2fab87f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:45:36.640104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-e2260149-97a3-444f-b32d-015dc5d6706b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.158812 Jul 26 15:45:36.640833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 595/1276] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:36 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:45:36.641892 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Getting quotas for user 236277d969f644de834cc3f61510c313 and project c3d0ec4c669b4f6d8bc80aa8d2fab87f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:45:36.656945 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:45:36.659324 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:45:36.822375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3c1f12ee-52cb-48f0-a0a4-40fec3a37148 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.651932 Jul 26 15:45:36.823025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 682/1277] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:45:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:45:36.834204 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7bd68477-cac4-4b53-92d9-6c8662955d16 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:36.834908 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7bd68477-cac4-4b53-92d9-6c8662955d16 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:36.889546 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-7bd68477-cac4-4b53-92d9-6c8662955d16 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:36.897809 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7bd68477-cac4-4b53-92d9-6c8662955d16 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1222 microversion: 2.1 time: 0.067462 Jul 26 15:45:36.904502 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 596/1278] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:36 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:37.661437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:37.662064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:37.669592 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:37.670045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:37.670864 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:37.671315 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:37.812404 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:37.817093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4b2fa127-05b9-4e96-9b40-b9f7b3203b1f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1269 microversion: 2.1 time: 0.159609 Jul 26 15:45:37.817803 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 683/1279] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:37 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:37.919805 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:37.920404 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:37.927939 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:37.928438 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:37.929238 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:37.929676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:37.996005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:38.004644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-73b4133e-781e-4d6e-8d4f-d0b9e9b4d38e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1226 microversion: 2.1 time: 0.088790 Jul 26 15:45:38.005218 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 597/1280] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:37 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:38.839056 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:38.839658 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:38.846535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:38.846997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:38.847774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:38.848278 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:38.989605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:38.997246 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d0895f88-06e1-4dbe-9d2c-c57f47ea06cd tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1455 microversion: 2.1 time: 0.162133 Jul 26 15:45:38.997811 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 684/1281] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:38 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:39.017607 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:39.018219 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:39.025169 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:39.025605 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:39.026464 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:39.026999 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:39.027128 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:39.027774 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:39.034917 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:39.035368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:39.036174 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:39.036645 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:39.104609 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:39.112877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1fe1d9c3-1fec-4dd4-9c53-964fe3fdf8c4 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1274 microversion: 2.1 time: 0.090189 Jul 26 15:45:39.113458 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 685/1282] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:39 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:45:39.187210 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:39.195181 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6dc62ecf-7b3a-4498-9222-174cbc5b7059 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1455 microversion: 2.1 time: 0.181622 Jul 26 15:45:39.195757 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 598/1283] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:39 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1455 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:40.135054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:40.135659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:40.142856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:40.143309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:40.144111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:40.144579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:40.259096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:40.267825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b4ae6f74-d662-4b8b-90e5-bb0106334d08 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1280 microversion: 2.1 time: 0.136795 Jul 26 15:45:40.268834 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 686/1284] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:40 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1280 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:41.278892 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-5a362996-9451-4b1d-b898-e5f4a1c7d09e req-a377306c-c45a-4bcf-8dce-9fcefe62cc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7364a3f-89de-41b6-bbd5-d1e714119e69", "tag": "b732dfba-4265-4c2a-816e-576e01232ef8"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:41.288819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:41.290743 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:41.300749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:41.301429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:41.302845 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:41.304418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:41.304699 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5a362996-9451-4b1d-b898-e5f4a1c7d09e req-a377306c-c45a-4bcf-8dce-9fcefe62cc00 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:41.305152 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5a362996-9451-4b1d-b898-e5f4a1c7d09e req-a377306c-c45a-4bcf-8dce-9fcefe62cc00 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:41.317246 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-5a362996-9451-4b1d-b898-e5f4a1c7d09e req-a377306c-c45a-4bcf-8dce-9fcefe62cc00 service nova] Creating event network-changed:b732dfba-4265-4c2a-816e-576e01232ef8 for instance b7364a3f-89de-41b6-bbd5-d1e714119e69 on hv-cinder-85103 Jul 26 15:45:41.322284 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-5a362996-9451-4b1d-b898-e5f4a1c7d09e req-a377306c-c45a-4bcf-8dce-9fcefe62cc00 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050626 Jul 26 15:45:41.325583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 599/1285] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:45:41.549666 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:41.557376 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-014faee8-d640-410e-b8d2-b839b56ec5fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.272925 Jul 26 15:45:41.558205 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 687/1286] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:41 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:45:41.721942 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-963d78b5-f784-41ce-8fed-cb58dc571213 req-e246fd1a-51bf-4339-95e0-b0fd500b1900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7719e4-b29e-45da-9e1d-ecd82e9a055d", "tag": "dd5052d4-4623-4d6e-bc77-6881107cc267"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:41.733155 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-963d78b5-f784-41ce-8fed-cb58dc571213 req-e246fd1a-51bf-4339-95e0-b0fd500b1900 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:41.733644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-963d78b5-f784-41ce-8fed-cb58dc571213 req-e246fd1a-51bf-4339-95e0-b0fd500b1900 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:41.747425 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-963d78b5-f784-41ce-8fed-cb58dc571213 req-e246fd1a-51bf-4339-95e0-b0fd500b1900 service nova] Creating event network-changed:dd5052d4-4623-4d6e-bc77-6881107cc267 for instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d on hv-cinder-85103 Jul 26 15:45:41.754341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-963d78b5-f784-41ce-8fed-cb58dc571213 req-e246fd1a-51bf-4339-95e0-b0fd500b1900 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037249 Jul 26 15:45:41.755053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 600/1287] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:45:42.581370 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:42.582031 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:42.588760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:42.589217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:42.590015 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:42.590425 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:42.742659 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:42.750753 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5e618f54-ac27-40cc-bf18-5a323375d178 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.173048 Jul 26 15:45:42.754959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 688/1288] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:42 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:43.773609 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:43.774341 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:43.782882 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:43.783342 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:43.784133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:43.786132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:43.931955 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:43.940726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8c4caca7-af8d-45fc-bcee-b150af582791 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.171469 Jul 26 15:45:43.941320 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 601/1289] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:43 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:44.963855 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:44.964484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:44.971388 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:44.971836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:44.972643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:44.973075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:45.108595 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:45.116349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5416ded6-6db2-474a-bf32-fff398e93ae6 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.156682 Jul 26 15:45:45.116934 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 689/1290] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:44 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:45.791844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-5fc661ad-1496-424c-867c-bff7e9065625 req-dde6cb8c-2fd3-4381-9552-de8a222dadf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7364a3f-89de-41b6-bbd5-d1e714119e69", "name": "network-vif-plugged", "status": "completed", "tag": "b732dfba-4265-4c2a-816e-576e01232ef8"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:45:45.802415 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5fc661ad-1496-424c-867c-bff7e9065625 req-dde6cb8c-2fd3-4381-9552-de8a222dadf4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:45.802855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-5fc661ad-1496-424c-867c-bff7e9065625 req-dde6cb8c-2fd3-4381-9552-de8a222dadf4 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:45.814556 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-5fc661ad-1496-424c-867c-bff7e9065625 req-dde6cb8c-2fd3-4381-9552-de8a222dadf4 service nova] Creating event network-vif-plugged:b732dfba-4265-4c2a-816e-576e01232ef8 for instance b7364a3f-89de-41b6-bbd5-d1e714119e69 on hv-cinder-85103 Jul 26 15:45:45.819253 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-5fc661ad-1496-424c-867c-bff7e9065625 req-dde6cb8c-2fd3-4381-9552-de8a222dadf4 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Jul 26 15:45:45.819852 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 602/1291] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:45:46.137950 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:46.138567 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:46.146293 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:46.147024 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:46.147809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:46.148385 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:46.300485 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:46.308000 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-93b0dfa5-736a-4783-b07c-7b153cd93ee2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.173928 Jul 26 15:45:46.308925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 690/1292] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:46 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:47.327618 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:47.332938 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:47.333641 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:47.339855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:47.340296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:47.341084 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:47.341520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:47.479035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:47.487390 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6e6202b2-507b-495b-a2b2-37717c4a2454 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1322 microversion: 2.1 time: 0.161190 Jul 26 15:45:47.487955 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 603/1293] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:47 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:45:48.509378 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:45:48.510036 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:45:48.511942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:48.512762 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:48.518688 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:48.524428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:48.524428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:45:48.524428 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:45:48.540997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:45:48.654922 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:45:48.662541 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-64c15fca-486f-48ae-93a0-7a810e0f41b7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1512 microversion: 2.1 time: 0.157181 Jul 26 15:45:48.663106 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 691/1294] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:45:48 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:06.252944 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aba566c-41ca-4653-8e21-2f047e3cba5b", "device": "/dev/sdb"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:06.255949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:06.259777 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=38 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:06.260484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=74 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:06.265308 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:06.265752 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:06.266510 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:06.266990 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:07.048333 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ba75eb20-01bf-4b27-9f65-daa2b5b78d6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "POST /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799399 Jul 26 15:46:07.048981 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 604/1295] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:46:06 2022] POST /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:46:08.468413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:08.468981 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:08.470966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:08.471749 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:08.476872 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:08.477372 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:08.478156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:08.478578 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:08.501202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lazy-loading 'flavor' on Instance uuid 754abb94-1dac-4f15-a3d8-1bea9e95a180 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:46:08.739637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-202ea12f-c528-42ca-94a8-9052702aa789 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "POST /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180/action" status: 202 len: 0 microversion: 2.1 time: 0.275317 Jul 26 15:46:08.740379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 692/1296] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:46:08 2022] POST /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:46:08.750685 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:08.751388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:08.758842 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:08.759287 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:08.760077 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:08.760518 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:08.903897 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:08.911874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-2d2ca7df-c469-429e-8d57-d46a58978235 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.165843 Jul 26 15:46:08.912453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 605/1297] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:08 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:09.935429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:09.936048 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:09.943002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:09.943541 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:09.944362 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:09.945538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:10.091684 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:10.099450 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6dbf3979-84e7-4eaa-bbfe-2dc1074e4e42 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.169528 Jul 26 15:46:10.100030 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 693/1298] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:09 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:46:11.121217 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:11.121857 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:11.128271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:11.128740 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:11.129491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:11.129920 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:11.265452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:11.273868 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6c36bd3a-93a9-459e-a1c6-a81d9d1ad672 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.156492 Jul 26 15:46:11.274563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 606/1299] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:11 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:12.295737 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:12.296319 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:12.302822 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:12.303264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:12.304018 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:12.304692 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:12.437186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:12.445301 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6756ed85-aefe-4876-8a97-adf1d424a20b tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.152975 Jul 26 15:46:12.445854 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 694/1300] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:12 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:46:13.466574 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:13.467196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:13.474727 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:13.474727 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:13.475174 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:13.475614 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:13.614697 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:13.622788 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a9f67ad9-ac07-430c-8bd4-afb667037038 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.160187 Jul 26 15:46:13.623364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 607/1301] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:13 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:14.644337 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:14.644873 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:14.652100 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:14.652573 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:14.653352 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:14.653825 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:14.789961 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:14.798579 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a68d4518-7664-4efd-a98f-683a94bc72bb tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.158058 Jul 26 15:46:14.799153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 695/1302] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:14 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:15.819536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:15.820150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:15.827558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:15.827998 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:15.828803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:15.829232 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:15.970197 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:15.978431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f03b0194-3338-443c-8356-14424b8f84f7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.162469 Jul 26 15:46:15.979019 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 608/1303] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:15 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:17.000001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:17.000680 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:17.007274 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:17.007736 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:17.008535 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:17.008980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:17.142925 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:17.151208 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8b123442-3c46-43f9-a340-cbffa82e7542 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.155105 Jul 26 15:46:17.151744 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 696/1304] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:16 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:18.172150 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:18.172824 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:18.179536 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:18.179981 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:18.180791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:18.181832 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:18.335706 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:18.343520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5a5c97e7-0f23-4e3d-b50e-c328003b0883 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.175253 Jul 26 15:46:18.349719 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 609/1305] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:18 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:46:19.366402 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:19.367564 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:19.392727 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:19.395019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:19.395019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:19.395019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:19.662005 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:19.670732 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ffa6748f-ad31-4f71-bae8-6e79e6aa15a1 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.309160 Jul 26 15:46:19.671454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 697/1306] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:19 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:20.695044 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:20.695682 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:20.702484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:20.702927 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:20.703676 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:20.704105 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:20.840069 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:20.847734 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-f9b1ca5f-098c-46b5-a3f8-0d0d3227866a tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.156489 Jul 26 15:46:20.848563 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 610/1307] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:20 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:21.871572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:21.872175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:21.878910 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:21.879359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:21.880122 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:21.880606 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:22.024841 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:22.027893 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f4d83b4c-1ec4-42cc-bd40-46af73025c62 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.161039 Jul 26 15:46:22.028489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 698/1308] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:21 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:23.050332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:23.050977 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:23.057960 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:23.058400 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:23.059160 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:23.059584 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:23.202704 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:23.210753 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-0c4a0eac-0021-470a-9cd2-a47437a23539 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.164278 Jul 26 15:46:23.211322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 611/1309] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:23 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:24.234217 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:24.234946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:24.241481 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.241928 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.242746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.243299 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.389120 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:24.397253 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cc158cec-78e0-4326-a147-f78aaa4b9e94 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1573 microversion: 2.1 time: 0.166912 Jul 26 15:46:24.398062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 699/1310] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:24 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:24.419878 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:24.420484 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:24.427524 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.427963 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.429660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.429660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.692806 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-41733d59-c22b-4a84-b7bd-13520358fa98 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "POST /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180/action" status: 202 len: 0 microversion: 2.1 time: 0.277462 Jul 26 15:46:24.693445 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 612/1311] 10.222.0.128 () {60 vars in 1283 bytes} [Tue Jul 26 15:46:24 2022] POST /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:46:24.702292 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:24.703001 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:24.709738 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.710254 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.711454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:24.711897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:24.858390 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:24.866304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ace02629-6a1d-41c4-ba19-3fe2de37747c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1521 microversion: 2.1 time: 0.168405 Jul 26 15:46:24.866875 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 700/1312] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:24 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:25.891395 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:25.892042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:25.898600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:25.899052 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:25.899817 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:25.900256 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:26.034031 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:26.041635 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-6491c59c-143a-4daf-bd8a-e715b3220052 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1521 microversion: 2.1 time: 0.154076 Jul 26 15:46:26.042449 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 613/1313] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:25 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:27.062897 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:27.063506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:27.070041 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:27.070490 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:27.071259 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:27.071701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:27.201809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:27.209312 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2613545c-5b54-430d-a4cd-ad0bbe550dfd tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1523 microversion: 2.1 time: 0.150299 Jul 26 15:46:27.209977 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 701/1314] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:27 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:27.997489 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-18c06838-f584-4766-956e-5a6b28b1fd86 req-f0651b43-11fe-4446-a7e8-bbc5f65ad909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "name": "network-vif-unplugged", "status": "completed", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:28.007431 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-18c06838-f584-4766-956e-5a6b28b1fd86 req-f0651b43-11fe-4446-a7e8-bbc5f65ad909 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:28.007873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-18c06838-f584-4766-956e-5a6b28b1fd86 req-f0651b43-11fe-4446-a7e8-bbc5f65ad909 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:28.024879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.compute.server_external_events [req-18c06838-f584-4766-956e-5a6b28b1fd86 req-f0651b43-11fe-4446-a7e8-bbc5f65ad909 service nova] Unable to find a host for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180. Dropping event network-vif-unplugged {{(pid=124842) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 15:46:28.024879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-18c06838-f584-4766-956e-5a6b28b1fd86 req-f0651b43-11fe-4446-a7e8-bbc5f65ad909 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.153750 Jul 26 15:46:28.024879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 614/1315] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 155 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 15:46:28.230997 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:28.231691 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:28.238268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:28.238756 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:28.239531 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:28.239970 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:28.398379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:28.406341 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a89a1dc5-a912-402f-b197-8dca6fb085a6 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1523 microversion: 2.1 time: 0.179358 Jul 26 15:46:28.412604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 702/1316] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:28 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:29.431207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:29.431823 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:29.439235 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:29.439680 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:29.440453 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:29.440916 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:29.636987 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:29.644557 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d68a593c-f5e8-4193-bcdb-d252bc75814c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.217210 Jul 26 15:46:29.645141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 615/1317] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:29 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:30.667534 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:30.668130 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:30.674287 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:30.674735 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:30.675506 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:30.675942 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:30.814195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:30.821856 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-502a61b7-7858-48c2-8f3a-15d2815bf479 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.159215 Jul 26 15:46:30.822417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 703/1318] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:30 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:31.843659 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:31.844237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:31.851202 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:31.851646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:31.852427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:31.852980 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:31.937574 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:31.938173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:31.945311 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:31.945764 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:31.946583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:31.947020 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:32.007221 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:32.017936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-a1813f18-baac-41c9-a450-128cccba379e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.176299 Jul 26 15:46:32.017936 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 616/1319] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:31 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:32.038623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lazy-loading 'services' on Instance uuid b7364a3f-89de-41b6-bbd5-d1e714119e69 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:46:32.193336 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-87724023-90e0-4654-9cd1-579e6f853467 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "DELETE /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69/os-volume_attachments/0aba566c-41ca-4653-8e21-2f047e3cba5b" status: 202 len: 0 microversion: 2.1 time: 0.260495 Jul 26 15:46:32.194197 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 704/1320] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:46:31 2022] DELETE /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69/os-volume_attachments/0aba566c-41ca-4653-8e21-2f047e3cba5b => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:46:33.036937 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:33.037562 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:33.045452 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.045900 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.046667 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.047094 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.186372 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:33.193932 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-d551ff4a-d54a-49a7-9a9f-f4ee28d40c28 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.160828 Jul 26 15:46:33.194507 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 617/1321] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:33 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:33.319186 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:33.319935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:33.327168 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.328538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.328538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.328842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.356215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:46:33.359181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:33.680062 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d658e61d-6467-421a-9db2-691c3706a228 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "DELETE /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 204 len: 0 microversion: 2.1 time: 0.365310 Jul 26 15:46:33.680714 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 705/1322] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:46:33 2022] DELETE /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:46:33.690035 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:33.690645 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:33.697586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.698034 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.699768 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:33.700360 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:33.833660 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:33.837180 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:33.841867 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c1e3ad28-aa82-42a2-8560-eb1d85acadfa tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1518 microversion: 2.1 time: 0.155783 Jul 26 15:46:33.848316 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 618/1323] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:33 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:34.215653 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:34.216340 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:34.222375 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:34.222818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:34.223572 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:34.224009 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:34.357867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:34.365634 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1e81cd19-96e8-420d-90ae-5a9db02d3c44 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.154176 Jul 26 15:46:34.366198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 706/1324] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:34 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:34.864988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:34.865644 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:34.873472 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:34.873923 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:34.874688 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:34.875132 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:35.009803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:35.018013 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-94198585-e238-40be-af5e-3d39e5bcfeb7 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1518 microversion: 2.1 time: 0.156942 Jul 26 15:46:35.018583 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 619/1325] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:34 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:35.387050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:35.387674 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:35.394423 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:35.394790 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:35.395565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:35.396007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:35.533583 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:35.541643 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8d2cb941-ad29-42b2-b309-ace83715ad60 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.158593 Jul 26 15:46:35.542216 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 707/1326] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:35 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:36.038624 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:36.039272 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:36.046146 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:36.046591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:36.047348 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:36.047787 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:36.281491 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:36.289782 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-867fd3c5-ad0a-489d-923f-af5ff6e4371c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1518 microversion: 2.1 time: 0.255242 Jul 26 15:46:36.290373 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 620/1327] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:36 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:36.564332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:36.564975 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:36.571637 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:36.572309 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:36.573357 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:36.573789 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:36.713792 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-2ce03171-89ce-4b2e-a2f4-ebc751335b7b req-712faf34-cbfd-4030-a29c-0ffe82b787ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7364a3f-89de-41b6-bbd5-d1e714119e69", "name": "network-vif-deleted", "tag": "b732dfba-4265-4c2a-816e-576e01232ef8"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:36.719459 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=37 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:36.726151 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:36.726520 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2ce03171-89ce-4b2e-a2f4-ebc751335b7b req-712faf34-cbfd-4030-a29c-0ffe82b787ed service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:36.726973 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2ce03171-89ce-4b2e-a2f4-ebc751335b7b req-712faf34-cbfd-4030-a29c-0ffe82b787ed service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:36.734799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9b744a8b-35be-4ea6-8bfd-e4dd11125465 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.174306 Jul 26 15:46:36.737563 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 708/1328] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:36 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:36.740196 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-2ce03171-89ce-4b2e-a2f4-ebc751335b7b req-712faf34-cbfd-4030-a29c-0ffe82b787ed service nova] Creating event network-vif-deleted:b732dfba-4265-4c2a-816e-576e01232ef8 for instance b7364a3f-89de-41b6-bbd5-d1e714119e69 on hv-cinder-85103 Jul 26 15:46:36.749841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-2ce03171-89ce-4b2e-a2f4-ebc751335b7b req-712faf34-cbfd-4030-a29c-0ffe82b787ed service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098113 Jul 26 15:46:36.750701 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 621/1329] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:46:37.312986 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:37.313598 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:37.319770 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:37.320220 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:37.321049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:37.321717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:37.359153 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:37.359678 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:37.360175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lazy-loading 'fault' on Instance uuid b7364a3f-89de-41b6-bbd5-d1e714119e69 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:46:37.403571 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:37.411061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4e814c4c-e420-4e1d-9b82-f71758eb7d43 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 200 len: 1312 microversion: 2.1 time: 0.102635 Jul 26 15:46:37.411698 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 709/1330] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:37 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:37.759056 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:37.759836 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:37.766297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:37.767207 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:37.767473 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:37.767903 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:37.905866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:37.913519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5fe1a21c-5867-41d1-ac36-cdcb693ca4e5 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.159475 Jul 26 15:46:37.914455 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 622/1331] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:37 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:38.432968 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:38.433623 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: b7364a3f-89de-41b6-bbd5-d1e714119e69] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:38.440397 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:38.441524 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:38.441690 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:38.442141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:38.456912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] HTTP exception thrown: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Request method failure captured: Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 HTTP/1.1 Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Awe-kAB29MaPCl8x3UQAiCh2I3S4tdTcAklHl1C-J6aRvFxmG1Ov_pxp6DnHO2pE3bRzzxyRsYVzKBQ7Bo4-VypesOTBcZbFN7jNne-mjNqct2rvhLgu-oL7QOiLS96lpZhm3NAB0RXkf87poiG7k5LMLNBS4SPAoVKPc85z4rqiEI Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: c3d0ec4c669b4f6d8bc80aa8d2fab87f Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:46:38.458614 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}] Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: c3d0ec4c669b4f6d8bc80aa8d2fab87f Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotTestJSON-1258069324-project Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 236277d969f644de834cc3f61510c313 Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotTestJSON-1258069324-project Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. Jul 26 15:46:38.460213 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'b7364a3f-89de-41b6-bbd5-d1e714119e69'} Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:46:38.461468 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. Jul 26 15:46:38.463183 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:46:38.464956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Returning 404 to user: Instance b7364a3f-89de-41b6-bbd5-d1e714119e69 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:46:38.464956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bace3eec-69d6-4144-9f04-0273ad8e1a6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69" status: 404 len: 111 microversion: 2.1 time: 0.030991 Jul 26 15:46:38.464956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 710/1332] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:38 2022] GET /compute/v2.1/servers/b7364a3f-89de-41b6-bbd5-d1e714119e69 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:46:38.935406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:38.936042 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:38.942410 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:38.942854 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:38.943606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:38.944037 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:39.079816 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:39.087729 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-5cbc7f43-988e-4136-9da4-70d86e00758e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.156716 Jul 26 15:46:39.088304 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 623/1333] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:38 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:40.109392 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:40.110002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:40.112420 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:46:40.117307 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:40.117807 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:40.118532 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:40.118967 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:40.259175 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:40.269426 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f609bd60-b4f7-44a3-9118-0fdaee682d24 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.164057 Jul 26 15:46:40.270004 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 711/1334] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:40 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:40.353998 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-2db99989-54ec-4f10-9885-30933e208546 req-ea081d9c-45ff-46f7-9a09-63c92d93b7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "name": "network-vif-plugged", "status": "completed", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:40.364707 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2db99989-54ec-4f10-9885-30933e208546 req-ea081d9c-45ff-46f7-9a09-63c92d93b7f3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:40.365142 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-2db99989-54ec-4f10-9885-30933e208546 req-ea081d9c-45ff-46f7-9a09-63c92d93b7f3 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:40.381953 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-2db99989-54ec-4f10-9885-30933e208546 req-ea081d9c-45ff-46f7-9a09-63c92d93b7f3 service nova] Creating event network-vif-plugged:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:46:40.382961 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-2db99989-54ec-4f10-9885-30933e208546 req-ea081d9c-45ff-46f7-9a09-63c92d93b7f3 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Jul 26 15:46:40.383656 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 624/1335] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:46:41.292203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:41.293172 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:41.300489 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:41.300954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:41.301720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:41.302159 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:41.434413 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:41.441959 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c7686fa1-2410-4580-beaf-3e57b68184b3 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.153643 Jul 26 15:46:41.442520 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 712/1336] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:41 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:46:42.464419 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:42.465148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:42.472364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:42.472847 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:42.473606 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:42.474038 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:42.613261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:42.621167 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-894a938d-15ab-4aa7-a087-3fd02d24db0e tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.161588 Jul 26 15:46:42.621725 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 625/1337] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:42 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:43.642565 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:43.643198 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:43.649826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:43.650264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:43.651022 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:43.651454 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:43.787002 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:43.794972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3b6a47dc-757b-4d33-a9e7-a7b54e38c2cf tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1579 microversion: 2.1 time: 0.156313 Jul 26 15:46:43.796555 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 713/1338] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:43 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:44.817296 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:44.817909 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:44.824623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:44.825072 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:44.825837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:44.826321 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:44.961874 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:44.969573 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-05b0cce3-3cbe-44f6-bea0-c6f2c6750c48 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1566 microversion: 2.1 time: 0.156234 Jul 26 15:46:44.975032 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 626/1339] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:44 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:48.929725 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-330365657", "imageRef": "c57b040f-7d82-468c-b586-88cc83d53fb3", "flavorRef": "452", "networks": [{"uuid": "d9462f87-b3b2-4fe2-af52-0b7bb7bb32a4"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:48.982203 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] validate_networks() for [('d9462f87-b3b2-4fe2-af52-0b7bb7bb32a4', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:46:49.640746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:46:49.641180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:46:49.641652 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:46:49.642061 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:46:49.642471 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:46:49.653264 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:49.653715 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:49.654513 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:49.654946 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:49.671695 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Getting quotas for project c3d0ec4c669b4f6d8bc80aa8d2fab87f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:46:49.675879 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Getting quotas for user 236277d969f644de834cc3f61510c313 and project c3d0ec4c669b4f6d8bc80aa8d2fab87f. Resources: {'ram', 'instances', 'cores'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:46:49.688547 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:46:49.691304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c57b040f-7d82-468c-b586-88cc83d53fb3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:46:49.825050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-afb5fc62-29c8-4f24-9054-43b60d3c153e tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.899779 Jul 26 15:46:49.825703 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 714/1340] 10.222.0.128 () {60 vars in 1152 bytes} [Tue Jul 26 15:46:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 15:46:49.837739 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-320d2646-bb40-4a1b-b827-5805bdd08ba0 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:49.838379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-320d2646-bb40-4a1b-b827-5805bdd08ba0 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:49.892517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-320d2646-bb40-4a1b-b827-5805bdd08ba0 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:49.899486 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-320d2646-bb40-4a1b-b827-5805bdd08ba0 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1222 microversion: 2.1 time: 0.065772 Jul 26 15:46:49.912519 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 627/1341] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:49 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:50.921191 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:50.921750 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:50.928360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:50.928863 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:50.929671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:50.930108 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:50.992383 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:50.999956 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-69747f3c-238c-49c3-96c4-89d032c86299 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1218 microversion: 2.1 time: 0.083588 Jul 26 15:46:51.000538 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 715/1342] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:50 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:52.021759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:52.022374 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:52.030358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:52.030762 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:52.031559 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:52.031957 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:52.112005 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:52.119747 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b43a13c4-2295-4553-960d-c2a478c546fb tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1280 microversion: 2.1 time: 0.102241 Jul 26 15:46:52.121259 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 628/1343] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:52 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:53.140662 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:53.141270 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:53.147802 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:53.148245 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:53.149027 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:53.149467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:53.228856 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-6fa1550a-13b8-47ee-b5bf-4fd3afebfd20 req-d7829bbb-5daa-4d89-bde8-709c9275c68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ec0d0e-bf65-43f5-a954-c73f8c7daf54", "tag": "4619e6fc-b8ad-4cef-94b4-32c625bff851"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:53.242941 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-6fa1550a-13b8-47ee-b5bf-4fd3afebfd20 req-d7829bbb-5daa-4d89-bde8-709c9275c68f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:53.243382 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-6fa1550a-13b8-47ee-b5bf-4fd3afebfd20 req-d7829bbb-5daa-4d89-bde8-709c9275c68f service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:53.256504 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-6fa1550a-13b8-47ee-b5bf-4fd3afebfd20 req-d7829bbb-5daa-4d89-bde8-709c9275c68f service nova] Creating event network-changed:4619e6fc-b8ad-4cef-94b4-32c625bff851 for instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 on hv-cinder-85103 Jul 26 15:46:53.261549 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-6fa1550a-13b8-47ee-b5bf-4fd3afebfd20 req-d7829bbb-5daa-4d89-bde8-709c9275c68f service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038963 Jul 26 15:46:53.262169 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 629/1344] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:46:53.294827 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:53.302771 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bf898f3c-0bb0-4c8f-aba5-11fe690f0652 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.165917 Jul 26 15:46:53.303343 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 716/1345] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:53 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:54.324086 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:54.324810 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:54.331009 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:54.331450 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:54.332921 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:54.333352 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:54.466183 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:54.474672 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-3e100771-a987-4561-9039-1da56f75af6c tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.155190 Jul 26 15:46:54.475237 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 630/1346] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:54 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:55.494989 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:55.495607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:55.502147 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:55.502599 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:55.503358 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:55.504368 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:55.636556 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:55.643972 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27be69b0-46c3-4139-bc48-1b090167be85 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.152811 Jul 26 15:46:55.645384 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 717/1347] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:55 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:56.666472 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:56.667088 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:56.673726 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:56.674173 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:56.674975 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:56.675406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:56.811382 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:56.819379 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4cb8f89e-a921-4908-a3d8-f3eab6f46e79 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.156964 Jul 26 15:46:56.819988 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 631/1348] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:56 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:57.840093 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:57.840720 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:57.847498 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:57.857196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:57.857196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:57.857196 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:57.980514 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:57.988066 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-df567b0c-a439-40ea-9bb2-e75c6f7f8c4f tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.151793 Jul 26 15:46:57.989256 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 718/1349] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:57 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:46:58.354835 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-02acbbb0-c912-45ee-8a9c-979436b8abea req-757e05a2-acd2-4e8d-832d-a8a354266728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec0d0e-bf65-43f5-a954-c73f8c7daf54", "name": "network-vif-plugged", "status": "completed", "tag": "4619e6fc-b8ad-4cef-94b4-32c625bff851"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:46:58.364956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-02acbbb0-c912-45ee-8a9c-979436b8abea req-757e05a2-acd2-4e8d-832d-a8a354266728 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:58.365403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-02acbbb0-c912-45ee-8a9c-979436b8abea req-757e05a2-acd2-4e8d-832d-a8a354266728 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:58.376317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-02acbbb0-c912-45ee-8a9c-979436b8abea req-757e05a2-acd2-4e8d-832d-a8a354266728 service nova] Creating event network-vif-plugged:4619e6fc-b8ad-4cef-94b4-32c625bff851 for instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 on hv-cinder-85103 Jul 26 15:46:58.381388 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-02acbbb0-c912-45ee-8a9c-979436b8abea req-757e05a2-acd2-4e8d-832d-a8a354266728 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030203 Jul 26 15:46:58.381978 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 632/1350] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:46:59.009877 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:46:59.010483 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:46:59.017035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:59.017480 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:59.018236 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:46:59.018671 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:46:59.151695 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:46:59.159211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e998418a-2c33-4727-96ac-a0e407ce0c9b tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.153293 Jul 26 15:46:59.159779 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 719/1351] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:46:59 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:00.179060 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell0:SELECT=2 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:00.183264 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:00.183956 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:00.190133 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:00.190579 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:00.191337 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:00.191826 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:00.326558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:00.335053 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b19e277f-0bd9-40ad-8e5e-53e29daae6ce tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1322 microversion: 2.1 time: 0.157333 Jul 26 15:47:00.335637 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 633/1352] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:00 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:01.356164 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:01.356751 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:01.358553 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:01.359209 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:01.364148 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:01.364651 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:01.365476 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:01.365906 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:01.496418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:01.504421 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-468b144e-d9e3-41c0-b7d9-3a1a72f3fbba tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1511 microversion: 2.1 time: 0.151830 Jul 26 15:47:01.505019 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 720/1353] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:01 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:01.525815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "776ff855-53e3-4059-affc-8cfcc0392df7", "device": "/dev/sdb"}} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:01.528178 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:01.534730 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:01.535206 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:01.535968 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:01.536399 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:02.182261 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-1eea1848-327a-4c64-a5e7-a8c14496133d tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "POST /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660259 Jul 26 15:47:02.182794 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 634/1354] 10.222.0.128 () {60 vars in 1328 bytes} [Tue Jul 26 15:47:01 2022] POST /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:22.224723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:22.225260 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:22.227624 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:22.229081 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:22.233833 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:22.234281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:22.235050 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:22.235484 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:22.317180 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lazy-loading 'services' on Instance uuid e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:47:22.521881 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ab42bad8-133b-4158-bb26-b21043511108 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "DELETE /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54/os-volume_attachments/776ff855-53e3-4059-affc-8cfcc0392df7" status: 202 len: 0 microversion: 2.1 time: 0.301009 Jul 26 15:47:22.522478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 721/1355] 10.222.0.128 () {58 vars in 1421 bytes} [Tue Jul 26 15:47:22 2022] DELETE /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54/os-volume_attachments/776ff855-53e3-4059-affc-8cfcc0392df7 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:47:23.649335 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=29 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:23.650332 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:47:23.654359 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:23.654946 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:23.661151 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:23.661601 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:23.662363 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:23.662803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:23.689901 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:47:23.985134 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-33c6b2e8-854b-43b0-9aa4-93d726e14697 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "DELETE /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 204 len: 0 microversion: 2.1 time: 0.337102 Jul 26 15:47:23.985767 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 635/1356] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:47:23 2022] DELETE /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:47:23.995860 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:23.999452 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:24.003723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.004181 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.005096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.005472 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.169045 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:24.176899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0cd36dd6-c820-4c0d-9d93-ae95ce4e0d84 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1517 microversion: 2.1 time: 0.186332 Jul 26 15:47:24.177464 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 722/1357] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:23 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:24.640369 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:24.640969 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:24.647982 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.648426 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.649216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.649785 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.677141 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:47:24.710593 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-d0e1ec14-0db0-4dc8-bf59-92b80fe7291d req-c9d35212-2f5f-404e-9d19-33d010956111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7719e4-b29e-45da-9e1d-ecd82e9a055d", "tag": "dd5052d4-4623-4d6e-bc77-6881107cc267"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:24.730799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d0e1ec14-0db0-4dc8-bf59-92b80fe7291d req-c9d35212-2f5f-404e-9d19-33d010956111 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.730799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d0e1ec14-0db0-4dc8-bf59-92b80fe7291d req-c9d35212-2f5f-404e-9d19-33d010956111 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.733069 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-d0e1ec14-0db0-4dc8-bf59-92b80fe7291d req-c9d35212-2f5f-404e-9d19-33d010956111 service nova] Creating event network-changed:dd5052d4-4623-4d6e-bc77-6881107cc267 for instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d on hv-cinder-85103 Jul 26 15:47:24.737920 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-d0e1ec14-0db0-4dc8-bf59-92b80fe7291d req-c9d35212-2f5f-404e-9d19-33d010956111 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098531 Jul 26 15:47:24.738519 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 723/1358] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:24.956240 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-eef6e38b-408d-4f7e-b67c-4db4415af4e9 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "DELETE /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 204 len: 0 microversion: 2.1 time: 0.319922 Jul 26 15:47:24.956944 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 636/1359] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:47:24 2022] DELETE /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:47:24.966418 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:24.967124 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:24.973360 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.973809 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:24.974584 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:24.975025 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:25.114494 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:25.123586 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bcfb28d7-a29b-4303-9d21-36e15eea1aab tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1580 microversion: 2.1 time: 0.162065 Jul 26 15:47:25.124165 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 724/1360] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:24 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1580 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:25.199866 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:25.200748 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:25.206959 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:25.207408 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:25.208175 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:25.208646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:25.342834 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:25.350250 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-22d2b1ae-05d0-48c9-8550-3cc1f545d356 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1517 microversion: 2.1 time: 0.154831 Jul 26 15:47:25.350855 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 637/1361] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:25 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:26.145867 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:26.146544 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:26.153951 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:26.154400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:26.155173 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:26.155589 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:26.292035 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:26.300077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5eedb482-32ad-4745-ab63-aa84b49f1303 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1580 microversion: 2.1 time: 0.158249 Jul 26 15:47:26.300665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 725/1362] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:26 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:26.371709 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:26.372322 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:26.378873 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:26.379317 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:26.380074 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:26.380537 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:26.511429 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:26.518861 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-b3f2f063-9f7b-4671-b5d7-df0e3a836909 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1517 microversion: 2.1 time: 0.151563 Jul 26 15:47:26.519427 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 638/1363] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:26 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:27.322894 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:27.323515 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:27.330227 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:27.330681 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:27.331459 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:27.331899 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:27.519301 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:27.529040 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-146ed564-df54-4753-a972-a1d86d3417b3 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1580 microversion: 2.1 time: 0.210544 Jul 26 15:47:27.530429 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 726/1364] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:27 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1580 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:27.541309 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:27.542791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:27.549493 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:27.549935 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:27.550720 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:27.551147 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:27.624448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '236277d969f644de834cc3f61510c313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d0ec4c669b4f6d8bc80aa8d2fab87f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:27.636600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-ab9b0bce-6175-4bf7-ab47-78f392c3f1d2 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 200 len: 1475 microversion: 2.1 time: 0.098862 Jul 26 15:47:27.648506 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 639/1365] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:27 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 1475 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:27.689866 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-9e8e53c5-e86f-416f-ae3c-52de4d96d116 req-fa147c87-69aa-4819-b00a-0ee9f34c1ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec0d0e-bf65-43f5-a954-c73f8c7daf54", "name": "network-vif-deleted", "tag": "4619e6fc-b8ad-4cef-94b4-32c625bff851"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:27.700077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-9e8e53c5-e86f-416f-ae3c-52de4d96d116 req-fa147c87-69aa-4819-b00a-0ee9f34c1ff8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:27.701007 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-9e8e53c5-e86f-416f-ae3c-52de4d96d116 req-fa147c87-69aa-4819-b00a-0ee9f34c1ff8 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:27.714020 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-9e8e53c5-e86f-416f-ae3c-52de4d96d116 req-fa147c87-69aa-4819-b00a-0ee9f34c1ff8 service nova] Creating event network-vif-deleted:4619e6fc-b8ad-4cef-94b4-32c625bff851 for instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 on hv-cinder-85103 Jul 26 15:47:27.719171 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-9e8e53c5-e86f-416f-ae3c-52de4d96d116 req-fa147c87-69aa-4819-b00a-0ee9f34c1ff8 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Jul 26 15:47:27.719828 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 727/1366] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:28.551188 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:28.551814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:28.559162 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:28.559623 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:28.560504 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:28.561580 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:28.628851 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:28.639844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4c3804e9-52e3-4e15-8ad8-bfbbcf5e45b0 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 200 len: 1229 microversion: 2.1 time: 0.090923 Jul 26 15:47:28.639844 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 640/1367] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:28 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:28.658363 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:28.659096 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] [instance: e4ec0d0e-bf65-43f5-a954-c73f8c7daf54] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:28.666633 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:28.667075 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:28.667958 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:28.668359 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:28.683607 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] HTTP exception thrown: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Request method failure captured: Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 HTTP/1.1 Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Awe-kAB29MaPCl8x3UQAiCh2I3S4tdTcAklHl1C-J6aRvFxmG1Ov_pxp6DnHO2pE3bRzzxyRsYVzKBQ7Bo4-VypesOTBcZbFN7jNne-mjNqct2rvhLgu-oL7QOiLS96lpZhm3NAB0RXkf87poiG7k5LMLNBS4SPAoVKPc85z4rqiEI Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: c3d0ec4c669b4f6d8bc80aa8d2fab87f Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:47:28.685305 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/c3d0ec4c669b4f6d8bc80aa8d2fab87f"}]}] Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: c3d0ec4c669b4f6d8bc80aa8d2fab87f Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1258069324 Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotTestJSON-1258069324-project Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 236277d969f644de834cc3f61510c313 Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotTestJSON-1258069324-project Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. Jul 26 15:47:28.705836 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'e4ec0d0e-bf65-43f5-a954-c73f8c7daf54'} Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:47:28.706701 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. Jul 26 15:47:28.708546 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:28.710195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] Returning 404 to user: Instance e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:47:28.710195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-95275ab7-26f2-494d-b780-1d704a062ed9 tempest-VolumesSnapshotTestJSON-1258069324 tempest-VolumesSnapshotTestJSON-1258069324-project] 10.222.0.128 "GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54" status: 404 len: 111 microversion: 2.1 time: 0.033120 Jul 26 15:47:28.710195 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 728/1368] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:28 2022] GET /compute/v2.1/servers/e4ec0d0e-bf65-43f5-a954-c73f8c7daf54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:47:29.659297 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:29.659914 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: 7d7719e4-b29e-45da-9e1d-ecd82e9a055d] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:29.668403 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:29.668949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:29.669993 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:29.670696 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:29.685422 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] HTTP exception thrown: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Request method failure captured: Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d HTTP/1.1 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Ap5erR12nQzR2owLWm5KJnERi3lAZHNdMkOIe880p19rIFGSIjjLiBAJWwROnW5WUcuU6xCdz3LQ9k2yg4ua6lyGW77eWXahuDGWR1-ttDxSqtu_218d7U9MR5cMWFMmLbS0nRNj0GbM4yzi-5BuxoEjsItbFUMFWBvK52H0wlVu10 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:47:29.687051 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/3e5dd905492343709b710fabd8a3d24f"}]}] Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 39f0a10b47b84bd1bd8ff8177362d791 Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. Jul 26 15:47:29.690668 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': '7d7719e4-b29e-45da-9e1d-ecd82e9a055d'} Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:47:29.691736 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. Jul 26 15:47:29.693366 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:29.694907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Returning 404 to user: Instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:47:29.694907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-23d1ad98-b5fa-4d90-b8ac-958497abd013 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d" status: 404 len: 111 microversion: 2.1 time: 0.033045 Jul 26 15:47:29.694907 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 641/1369] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:29 2022] GET /compute/v2.1/servers/7d7719e4-b29e-45da-9e1d-ecd82e9a055d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:47:29.746826 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-6c0a91fe-19db-4232-b2cc-540d6fd98257 req-1475d4f6-75ef-4242-b5bd-a565fe524985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7719e4-b29e-45da-9e1d-ecd82e9a055d", "name": "network-vif-deleted", "tag": "dd5052d4-4623-4d6e-bc77-6881107cc267"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:29.756604 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6c0a91fe-19db-4232-b2cc-540d6fd98257 req-1475d4f6-75ef-4242-b5bd-a565fe524985 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:29.757044 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6c0a91fe-19db-4232-b2cc-540d6fd98257 req-1475d4f6-75ef-4242-b5bd-a565fe524985 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:29.769600 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-6c0a91fe-19db-4232-b2cc-540d6fd98257 req-1475d4f6-75ef-4242-b5bd-a565fe524985 service nova] Creating event network-vif-deleted:dd5052d4-4623-4d6e-bc77-6881107cc267 for instance 7d7719e4-b29e-45da-9e1d-ecd82e9a055d on hv-cinder-85103 Jul 26 15:47:29.774702 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-6c0a91fe-19db-4232-b2cc-540d6fd98257 req-1475d4f6-75ef-4242-b5bd-a565fe524985 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Jul 26 15:47:29.775304 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 729/1370] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:36.151895 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:36.153811 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:36.154021 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-d2b4baaa-ea6a-47b9-8366-ac03360f8c14 req-0c5dbedb-54e8-493a-93dd-f41dcad84add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1995e5-37be-4500-aed3-b5e1a2fd0c0a", "tag": "17ca4eda-c8b5-415b-89fb-527bd2c2a98d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:36.161291 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:36.162036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:36.163036 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:36.163460 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:36.164189 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d2b4baaa-ea6a-47b9-8366-ac03360f8c14 req-0c5dbedb-54e8-493a-93dd-f41dcad84add service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:36.164677 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d2b4baaa-ea6a-47b9-8366-ac03360f8c14 req-0c5dbedb-54e8-493a-93dd-f41dcad84add service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:36.177379 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-d2b4baaa-ea6a-47b9-8366-ac03360f8c14 req-0c5dbedb-54e8-493a-93dd-f41dcad84add service nova] Creating event network-changed:17ca4eda-c8b5-415b-89fb-527bd2c2a98d for instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a on hv-cinder-85103 Jul 26 15:47:36.182869 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-d2b4baaa-ea6a-47b9-8366-ac03360f8c14 req-0c5dbedb-54e8-493a-93dd-f41dcad84add service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036489 Jul 26 15:47:36.184505 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 730/1371] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:36.196451 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Going to try to terminate instance {{(pid=124842) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:47:36.459890 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-7f72c592-459f-4de3-abe8-72250d6234b1 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "DELETE /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 204 len: 0 microversion: 2.1 time: 0.316541 Jul 26 15:47:36.460828 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 642/1372] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:47:36 2022] DELETE /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:47:36.470467 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:36.471162 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:36.477818 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:36.478268 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:36.479194 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:36.479635 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:36.625400 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:36.633696 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b0a6d44b-aeea-46d4-a655-d0b5c303124b tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1579 microversion: 2.1 time: 0.167542 Jul 26 15:47:36.634332 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 731/1373] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:36 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:37.657201 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:37.657815 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:37.664330 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:37.664814 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:37.665571 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:37.666008 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:37.800693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:37.808492 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-4e79af24-722d-4b68-88f2-0daadecb5106 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1579 microversion: 2.1 time: 0.156298 Jul 26 15:47:37.809612 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 643/1374] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:37 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:38.693729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-0801db4b-dde8-4faf-a2af-4a0440a0da17 req-9db2dd80-9dc5-4b70-a187-07fd710ba4fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1995e5-37be-4500-aed3-b5e1a2fd0c0a", "name": "network-vif-deleted", "tag": "17ca4eda-c8b5-415b-89fb-527bd2c2a98d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:47:38.705665 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0801db4b-dde8-4faf-a2af-4a0440a0da17 req-9db2dd80-9dc5-4b70-a187-07fd710ba4fa service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:38.706077 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0801db4b-dde8-4faf-a2af-4a0440a0da17 req-9db2dd80-9dc5-4b70-a187-07fd710ba4fa service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:38.717527 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-0801db4b-dde8-4faf-a2af-4a0440a0da17 req-9db2dd80-9dc5-4b70-a187-07fd710ba4fa service nova] Creating event network-vif-deleted:17ca4eda-c8b5-415b-89fb-527bd2c2a98d for instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a on hv-cinder-85103 Jul 26 15:47:38.722448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-0801db4b-dde8-4faf-a2af-4a0440a0da17 req-9db2dd80-9dc5-4b70-a187-07fd710ba4fa service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 Jul 26 15:47:38.723049 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 732/1375] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:47:38.831689 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:38.832271 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:38.839840 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:38.840315 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:38.841121 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:38.841587 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:38.905942 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f0a10b47b84bd1bd8ff8177362d791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5dd905492343709b710fabd8a3d24f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:47:38.914063 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c7c62027-b5e8-47a8-a39f-fb8218861817 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 200 len: 1228 microversion: 2.1 time: 0.086412 Jul 26 15:47:38.914522 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 644/1376] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:38 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 1228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:47:39.936448 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:39.937345 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: ab1995e5-37be-4500-aed3-b5e1a2fd0c0a] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:39.944339 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:39.944819 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:39.945586 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:39.946215 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:39.960064 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] HTTP exception thrown: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Request method failure captured: Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a HTTP/1.1 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Ap5erR12nQzR2owLWm5KJnERi3lAZHNdMkOIe880p19rIFGSIjjLiBAJWwROnW5WUcuU6xCdz3LQ9k2yg4ua6lyGW77eWXahuDGWR1-ttDxSqtu_218d7U9MR5cMWFMmLbS0nRNj0GbM4yzi-5BuxoEjsItbFUMFWBvK52H0wlVu10 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:47:39.962028 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/3e5dd905492343709b710fabd8a3d24f"}]}] Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 39f0a10b47b84bd1bd8ff8177362d791 Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. Jul 26 15:47:39.963849 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'ab1995e5-37be-4500-aed3-b5e1a2fd0c0a'} Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:47:39.965105 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. Jul 26 15:47:39.967504 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:39.969129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Returning 404 to user: Instance ab1995e5-37be-4500-aed3-b5e1a2fd0c0a could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:47:39.969129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bed9e411-9adf-48bd-aa73-57c22bcd20c4 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a" status: 404 len: 111 microversion: 2.1 time: 0.031923 Jul 26 15:47:39.969129 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 733/1377] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:39 2022] GET /compute/v2.1/servers/ab1995e5-37be-4500-aed3-b5e1a2fd0c0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:47:40.760435 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:40.761048 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:40.766912 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:40.767358 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:40.768116 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:40.768579 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:40.782208 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.wsgi [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] HTTP exception thrown: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Request method failure captured: Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: request: DELETE /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 HTTP/1.1 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept: application/json Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Accept-Encoding: identity Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Connection: close Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Length: 0 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Content-Type: application/json Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Host: 10.222.0.128 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Openstack-System-Scope: None Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: User-Agent: python-urllib3/1.26.10 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Auth-Token: gAAAAABi4Ap5erR12nQzR2owLWm5KJnERi3lAZHNdMkOIe880p19rIFGSIjjLiBAJWwROnW5WUcuU6xCdz3LQ9k2yg4ua6lyGW77eWXahuDGWR1-ttDxSqtu_218d7U9MR5cMWFMmLbS0nRNj0GbM4yzi-5BuxoEjsItbFUMFWBvK52H0wlVu10 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Id: None Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Domain-Name: None Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Identity-Status: Confirmed Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Is-Admin-Project: True Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Id: default Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Domain-Name: Default Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Project-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Role: member,reader Jul 26 15:47:40.783862 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Roles: member,reader Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/3e5dd905492343709b710fabd8a3d24f"}]}] Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-Tenant-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Id: default Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Domain-Name: Default Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Id: 39f0a10b47b84bd1bd8ff8177362d791 Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: X-User-Name: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: method: > Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: exception: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.785646 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: action_args: {'id': 'a3f4641a-1f7d-473c-a239-03183b2ef9b9'} Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:47:40.786526 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.787879 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.789462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Returning 404 to user: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. {{(pid=124842) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:47:40.789462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-305823c2-714d-4d42-9457-82eced87be36 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "DELETE /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 404 len: 111 microversion: 2.1 time: 0.029045 Jul 26 15:47:40.789462 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 645/1378] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:47:40 2022] DELETE /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:47:40.794785 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:40.795411 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] [instance: a3f4641a-1f7d-473c-a239-03183b2ef9b9] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:47:40.801760 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:40.802202 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:40.802966 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:47:40.803403 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:47:40.817111 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] HTTP exception thrown: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Request method failure captured: Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 HTTP/1.1 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4Ap5erR12nQzR2owLWm5KJnERi3lAZHNdMkOIe880p19rIFGSIjjLiBAJWwROnW5WUcuU6xCdz3LQ9k2yg4ua6lyGW77eWXahuDGWR1-ttDxSqtu_218d7U9MR5cMWFMmLbS0nRNj0GbM4yzi-5BuxoEjsItbFUMFWBvK52H0wlVu10 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:47:40.818617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/3e5dd905492343709b710fabd8a3d24f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/3e5dd905492343709b710fabd8a3d24f"}]}] Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 3e5dd905492343709b710fabd8a3d24f Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-845887562 Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: 39f0a10b47b84bd1bd8ff8177362d791 Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-845887562-project Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.820512 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a3f4641a-1f7d-473c-a239-03183b2ef9b9'} Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:47:40.821561 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. Jul 26 15:47:40.823117 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:47:40.824842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Returning 404 to user: Instance a3f4641a-1f7d-473c-a239-03183b2ef9b9 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:47:40.824842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4892a335-6f2c-4ee6-b0ab-47cfaaf21b61 tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 26 15:47:40.824842 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 734/1379] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:47:40 2022] GET /compute/v2.1/servers/a3f4641a-1f7d-473c-a239-03183b2ef9b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:47:44.459841 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-9be331f4-add6-4403-9dd5-431f76f8fa7f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] Calling method '.version_select at 0x7f346aca8940>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:47:44.558292 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-9be331f4-add6-4403-9dd5-431f76f8fa7f tempest-TestVolumeBootPattern-845887562 tempest-TestVolumeBootPattern-845887562-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1871278468" status: 202 len: 0 microversion: 2.1 time: 0.102149 Jul 26 15:47:44.559448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 646/1380] 10.222.0.128 () {58 vars in 1268 bytes} [Tue Jul 26 15:47:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1871278468 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:48:15.437723 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:15.438258 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:15.440349 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=28 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:15.441084 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:15.445216 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:15.446104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG dbcounter [-] [124842] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124842) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:48:15.446229 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:15.446622 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:15.448141 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:15.448746 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:15.450157 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [req-051e4f93-9f97-4d5c-9bc9-c8844b7e27b8 req-59bbaae1-3cef-41c8-aa36-d80cfa0afc99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:48:15.467628 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-051e4f93-9f97-4d5c-9bc9-c8844b7e27b8 req-59bbaae1-3cef-41c8-aa36-d80cfa0afc99 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:15.468793 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [req-051e4f93-9f97-4d5c-9bc9-c8844b7e27b8 req-59bbaae1-3cef-41c8-aa36-d80cfa0afc99 service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:15.480876 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:48:15.481871 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.compute.server_external_events [req-051e4f93-9f97-4d5c-9bc9-c8844b7e27b8 req-59bbaae1-3cef-41c8-aa36-d80cfa0afc99 service nova] Creating event network-changed:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:48:15.488669 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [req-051e4f93-9f97-4d5c-9bc9-c8844b7e27b8 req-59bbaae1-3cef-41c8-aa36-d80cfa0afc99 service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044873 Jul 26 15:48:15.489267 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 647/1381] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:48:15.815289 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d8796c1b-95c4-4ae0-9369-2e5e4f370736 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "DELETE /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 204 len: 0 microversion: 2.1 time: 0.381407 Jul 26 15:48:15.815912 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 735/1382] 10.222.0.128 () {58 vars in 1244 bytes} [Tue Jul 26 15:48:15 2022] DELETE /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:48:15.825796 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:15.826578 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:15.834192 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:15.834733 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:15.835619 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:15.836123 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:15.995512 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:48:16.004148 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-65781267-90a0-4a96-b993-48621cb5ba0f tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.183464 Jul 26 15:48:16.004759 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 648/1383] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:48:15 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:48:17.026255 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:17.026954 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:17.033478 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:17.033935 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:17.034717 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:17.035154 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:17.172843 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:48:17.180417 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28c19374-853b-4668-a1ab-54073c45d7cc tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1572 microversion: 2.1 time: 0.158588 Jul 26 15:48:17.182156 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 736/1384] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:48:17 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:48:18.203693 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:18.204288 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:18.211540 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:18.217770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:18.217770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:18.217770 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:18.268829 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-1bc17e0f-da31-4df6-9b67-ba24b6bae43f req-f44c0dc3-b2be-4060-a171-29a9b75464ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "754abb94-1dac-4f15-a3d8-1bea9e95a180", "name": "network-vif-deleted", "tag": "24546090-7032-4878-8314-6034040c9df2"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:48:18.283600 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:48:18.285534 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1bc17e0f-da31-4df6-9b67-ba24b6bae43f req-f44c0dc3-b2be-4060-a171-29a9b75464ef service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:18.286054 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1bc17e0f-da31-4df6-9b67-ba24b6bae43f req-f44c0dc3-b2be-4060-a171-29a9b75464ef service nova] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:18.293406 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-8c9776cd-3c47-4b63-b196-f4b2e6e4da69 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1386 microversion: 2.1 time: 0.094359 Jul 26 15:48:18.298281 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 649/1385] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:48:18 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:48:18.299474 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-1bc17e0f-da31-4df6-9b67-ba24b6bae43f req-f44c0dc3-b2be-4060-a171-29a9b75464ef service nova] Creating event network-vif-deleted:24546090-7032-4878-8314-6034040c9df2 for instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 on hv-cinder-85103 Jul 26 15:48:18.304529 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-1bc17e0f-da31-4df6-9b67-ba24b6bae43f req-f44c0dc3-b2be-4060-a171-29a9b75464ef service nova] 10.222.0.128 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039742 Jul 26 15:48:18.306605 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 737/1386] 10.222.0.128 () {64 vars in 1322 bytes} [Tue Jul 26 15:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:48:19.314837 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:19.315454 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.compute.api [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124842) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:19.322171 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:19.322599 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:19.323364 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:19.323803 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:19.354930 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:19.355381 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG oslo_concurrency.lockutils [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124842) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:19.355833 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.objects.instance [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lazy-loading 'fault' on Instance uuid 754abb94-1dac-4f15-a3d8-1bea9e95a180 {{(pid=124842) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:48:19.397090 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.policy [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2d108f5b3e64655a62cc6d25255ff87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06fcba3614a4f428778ccfa4d2ac3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124842) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:48:19.405104 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-c3fb3468-d1a4-40ba-b997-1eeff5cbc336 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 200 len: 1228 microversion: 2.1 time: 0.094107 Jul 26 15:48:19.407791 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 650/1387] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:48:19 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:48:20.428223 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:20.428875 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] [instance: 754abb94-1dac-4f15-a3d8-1bea9e95a180] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:48:20.435528 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:20.435980 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:20.436786 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:48:20.437224 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Lock "06f98f67-0c8d-404d-9439-56d0670c1f78" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:48:20.450798 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] HTTP exception thrown: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Request method failure captured: Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 HTTP/1.1 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Connection: close Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Host: 10.222.0.128 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.10 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi4AuEMi0LlZjreF-9s4IRQHFmp5l1zYxgz9F8i2qw2tYXHD49GMGvzKVhAqDUinYwpkyVpXgx24INbxoN2t1Xsaqbb-AH-_B3GmIlb7cWsM0EGMN52_v98Bg1ll8s8zbZTyHell86Lqo4jP4L-O0bSQPv31do-7y3n1QpLllui6qLRa8 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Id: f06fcba3614a4f428778ccfa4d2ac3eb Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestShelveInstance-834654062 Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Role: member,reader Jul 26 15:48:20.452437 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Roles: member,reader Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f06fcba3614a4f428778ccfa4d2ac3eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.128:8080", "publicURL": "http://10.222.0.128:8080/v1/AUTH_f06fcba3614a4f428778ccfa4d2ac3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/volume/v3/f06fcba3614a4f428778ccfa4d2ac3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.128/compute/v2/f06fcba3614a4f428778ccfa4d2ac3eb"}]}] Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestShelveInstance-834654062 Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f06fcba3614a4f428778ccfa4d2ac3eb Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestShelveInstance-834654062 Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User: tempest-TestShelveInstance-834654062-project Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Id: e2d108f5b3e64655a62cc6d25255ff87 Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestShelveInstance-834654062-project Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: method: > Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: exception: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. Jul 26 15:48:20.454251 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: action_args: {'id': '754abb94-1dac-4f15-a3d8-1bea9e95a180'} Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:48:20.455493 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. Jul 26 15:48:20.457211 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 26 15:48:20.458799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Returning 404 to user: Instance 754abb94-1dac-4f15-a3d8-1bea9e95a180 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:48:20.458799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-46f83bd3-a6c3-4422-8dfb-bf1f90b87ab7 tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180" status: 404 len: 111 microversion: 2.1 time: 0.030474 Jul 26 15:48:20.458799 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 738/1388] 10.222.0.128 () {58 vars in 1241 bytes} [Tue Jul 26 15:48:20 2022] GET /compute/v2.1/servers/754abb94-1dac-4f15-a3d8-1bea9e95a180 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:48:20.675755 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: DEBUG nova.api.openstack.wsgi [None req-222d15ad-fed5-403d-85b4-78817851fd3c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] Calling method '.version_select at 0x7f346a990040>' {{(pid=124842) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:48:20.747949 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO nova.api.openstack.requestlog [None req-222d15ad-fed5-403d-85b4-78817851fd3c tempest-TestShelveInstance-834654062 tempest-TestShelveInstance-834654062-project] 10.222.0.128 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093914375" status: 202 len: 0 microversion: 2.1 time: 0.077923 Jul 26 15:48:20.748568 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: [pid: 124842|app: 0|req: 651/1389] 10.222.0.128 () {58 vars in 1259 bytes} [Tue Jul 26 15:48:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2093914375 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:48:53.988591 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:48:53.989301 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:49:22.349475 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:49:22.350192 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Tue Jul 26 15:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:50:23.685517 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:50:23.686168 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:50:48.516884 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:50:48.517586 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:50:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:50:49.192396 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:50:49.193039 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Tue Jul 26 15:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:52:07.015729 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:52:07.016617 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Tue Jul 26 15:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:52:13.996960 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:52:13.997558 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:52:42.357847 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:52:42.359167 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Tue Jul 26 15:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:53:43.693917 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:53:43.694564 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:54:08.527448 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:54:08.529602 dv-cinder-851032-1-iscsi devstack@n-api.service[124842]: Tue Jul 26 15:54:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:54:09.200669 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:54:09.201281 dv-cinder-851032-1-iscsi devstack@n-api.service[124843]: Tue Jul 26 15:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!